2023-07-19 10:10:12,775 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 10:10:13,030 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d 2023-07-19 10:10:13,031 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-19 10:10:13,031 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-19 10:10:13,071 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 10:10:13,393 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 10:10:13,393 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7, deleteOnExit=true 2023-07-19 10:10:13,394 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 10:10:13,394 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/test.cache.data in system properties and HBase conf 2023-07-19 10:10:13,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 10:10:13,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop.log.dir in system properties and HBase conf 2023-07-19 10:10:13,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 10:10:13,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 10:10:13,397 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 10:10:13,794 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 10:10:13,801 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:13,802 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:13,802 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 10:10:13,803 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:13,803 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 10:10:13,804 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 10:10:13,804 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:13,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:13,805 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 10:10:13,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/nfs.dump.dir in system properties and HBase conf 2023-07-19 10:10:13,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir in system properties and HBase conf 2023-07-19 10:10:13,806 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:13,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 10:10:13,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 10:10:14,482 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 10:10:14,487 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 10:10:14,841 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 10:10:15,047 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 10:10:15,063 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:15,106 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:15,144 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_localhost_34087_hdfs____.z8hxd4/webapp 2023-07-19 10:10:15,323 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34087 2023-07-19 10:10:15,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 10:10:15,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 10:10:15,935 WARN [Listener at localhost/36553] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:16,046 WARN [Listener at localhost/36553] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 10:10:16,070 WARN [Listener at localhost/36553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:16,079 INFO [Listener at localhost/36553] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:16,170 INFO [Listener at localhost/36553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_localhost_39999_datanode____k8k2u2/webapp 2023-07-19 10:10:16,315 INFO [Listener at localhost/36553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39999 2023-07-19 10:10:16,863 WARN [Listener at localhost/35555] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:16,918 WARN [Listener at localhost/35555] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 10:10:16,926 WARN [Listener at localhost/35555] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:16,928 INFO [Listener at localhost/35555] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:16,944 INFO [Listener at localhost/35555] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_localhost_35867_datanode____.75x1s2/webapp 2023-07-19 10:10:17,075 INFO [Listener at localhost/35555] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35867 2023-07-19 10:10:17,094 WARN [Listener at localhost/36873] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:17,165 WARN [Listener at localhost/36873] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 10:10:17,174 WARN [Listener at localhost/36873] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:17,177 INFO [Listener at localhost/36873] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:17,206 INFO [Listener at localhost/36873] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_localhost_38507_datanode____dwmi1q/webapp 2023-07-19 10:10:17,362 INFO [Listener at localhost/36873] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38507 2023-07-19 10:10:17,389 WARN [Listener at localhost/34429] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 10:10:17,707 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1cf667dc4f6c12ba: Processing first storage report for DS-b829176d-e948-4c57-9cbf-464d1dbf8c15 from datanode 791f0142-ab43-497e-9c37-ed4892b3753c 2023-07-19 10:10:17,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1cf667dc4f6c12ba: from storage DS-b829176d-e948-4c57-9cbf-464d1dbf8c15 node DatanodeRegistration(127.0.0.1:46665, datanodeUuid=791f0142-ab43-497e-9c37-ed4892b3753c, infoPort=35457, infoSecurePort=0, ipcPort=35555, storageInfo=lv=-57;cid=testClusterID;nsid=45600972;c=1689761414590), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,710 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf60948a2f5636fb: Processing first storage report for DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b from datanode 4b42019a-24b4-45d2-b9dd-439499dcd76a 2023-07-19 10:10:17,710 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf60948a2f5636fb: from storage DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b node DatanodeRegistration(127.0.0.1:43005, datanodeUuid=4b42019a-24b4-45d2-b9dd-439499dcd76a, infoPort=33793, infoSecurePort=0, ipcPort=36873, storageInfo=lv=-57;cid=testClusterID;nsid=45600972;c=1689761414590), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,710 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1cf667dc4f6c12ba: Processing first storage report for DS-8147e9b5-8e31-4579-b30e-d7f44295f05c from datanode 791f0142-ab43-497e-9c37-ed4892b3753c 2023-07-19 10:10:17,710 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1cf667dc4f6c12ba: from storage DS-8147e9b5-8e31-4579-b30e-d7f44295f05c node DatanodeRegistration(127.0.0.1:46665, datanodeUuid=791f0142-ab43-497e-9c37-ed4892b3753c, infoPort=35457, infoSecurePort=0, ipcPort=35555, storageInfo=lv=-57;cid=testClusterID;nsid=45600972;c=1689761414590), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,711 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf60948a2f5636fb: Processing first storage report for DS-cb030a68-ca80-4acf-baac-db02c781dd6a from datanode 4b42019a-24b4-45d2-b9dd-439499dcd76a 2023-07-19 10:10:17,711 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf60948a2f5636fb: from storage DS-cb030a68-ca80-4acf-baac-db02c781dd6a node DatanodeRegistration(127.0.0.1:43005, datanodeUuid=4b42019a-24b4-45d2-b9dd-439499dcd76a, infoPort=33793, infoSecurePort=0, ipcPort=36873, storageInfo=lv=-57;cid=testClusterID;nsid=45600972;c=1689761414590), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,711 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe9040a7012d2d545: Processing first storage report for DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd from datanode 730bd243-de7a-49b0-a25b-edd40410df63 2023-07-19 10:10:17,711 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe9040a7012d2d545: from storage DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd node DatanodeRegistration(127.0.0.1:46103, datanodeUuid=730bd243-de7a-49b0-a25b-edd40410df63, infoPort=40145, infoSecurePort=0, ipcPort=34429, storageInfo=lv=-57;cid=testClusterID;nsid=45600972;c=1689761414590), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,711 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe9040a7012d2d545: Processing first storage report for DS-215a0e57-6c56-4ac3-86be-728da81b9022 from datanode 730bd243-de7a-49b0-a25b-edd40410df63 2023-07-19 10:10:17,711 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe9040a7012d2d545: from storage DS-215a0e57-6c56-4ac3-86be-728da81b9022 node DatanodeRegistration(127.0.0.1:46103, datanodeUuid=730bd243-de7a-49b0-a25b-edd40410df63, infoPort=40145, infoSecurePort=0, ipcPort=34429, storageInfo=lv=-57;cid=testClusterID;nsid=45600972;c=1689761414590), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 10:10:17,977 DEBUG [Listener at localhost/34429] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d 2023-07-19 10:10:18,105 INFO [Listener at localhost/34429] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/zookeeper_0, clientPort=54485, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 10:10:18,133 INFO [Listener at localhost/34429] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54485 2023-07-19 10:10:18,145 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:18,148 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:18,896 INFO [Listener at localhost/34429] util.FSUtils(471): Created version file at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 with version=8 2023-07-19 10:10:18,897 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/hbase-staging 2023-07-19 10:10:19,321 INFO [Listener at localhost/34429] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 10:10:19,939 INFO [Listener at localhost/34429] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:19,972 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:19,973 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:19,973 INFO [Listener at localhost/34429] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:19,973 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:19,974 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,133 INFO [Listener at localhost/34429] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,235 DEBUG [Listener at localhost/34429] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 10:10:20,346 INFO [Listener at localhost/34429] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38127 2023-07-19 10:10:20,362 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,364 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,387 INFO [Listener at localhost/34429] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38127 connecting to ZooKeeper ensemble=127.0.0.1:54485 2023-07-19 10:10:20,477 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:381270x0, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38127-0x1017d0f8e5b0000 connected 2023-07-19 10:10:20,567 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,568 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,587 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,606 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38127 2023-07-19 10:10:20,607 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38127 2023-07-19 10:10:20,608 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38127 2023-07-19 10:10:20,610 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38127 2023-07-19 10:10:20,615 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38127 2023-07-19 10:10:20,625 INFO [Listener at localhost/34429] master.HMaster(444): hbase.rootdir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, hbase.cluster.distributed=false 2023-07-19 10:10:20,714 INFO [Listener at localhost/34429] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:20,714 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,714 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,714 INFO [Listener at localhost/34429] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:20,714 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,715 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,720 INFO [Listener at localhost/34429] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,723 INFO [Listener at localhost/34429] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41773 2023-07-19 10:10:20,727 INFO [Listener at localhost/34429] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 10:10:20,735 INFO [Listener at localhost/34429] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 10:10:20,737 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,740 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,742 INFO [Listener at localhost/34429] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41773 connecting to ZooKeeper ensemble=127.0.0.1:54485 2023-07-19 10:10:20,753 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:417730x0, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41773-0x1017d0f8e5b0001 connected 2023-07-19 10:10:20,755 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,756 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,757 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,759 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41773 2023-07-19 10:10:20,763 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41773 2023-07-19 10:10:20,765 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41773 2023-07-19 10:10:20,766 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41773 2023-07-19 10:10:20,769 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41773 2023-07-19 10:10:20,785 INFO [Listener at localhost/34429] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:20,785 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,785 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,786 INFO [Listener at localhost/34429] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:20,786 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,786 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,786 INFO [Listener at localhost/34429] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,796 INFO [Listener at localhost/34429] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36483 2023-07-19 10:10:20,797 INFO [Listener at localhost/34429] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 10:10:20,804 INFO [Listener at localhost/34429] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 10:10:20,805 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,811 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,814 INFO [Listener at localhost/34429] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36483 connecting to ZooKeeper ensemble=127.0.0.1:54485 2023-07-19 10:10:20,817 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:364830x0, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36483-0x1017d0f8e5b0002 connected 2023-07-19 10:10:20,819 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,820 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,821 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,828 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36483 2023-07-19 10:10:20,828 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36483 2023-07-19 10:10:20,829 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36483 2023-07-19 10:10:20,829 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36483 2023-07-19 10:10:20,830 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36483 2023-07-19 10:10:20,848 INFO [Listener at localhost/34429] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 10:10:20,848 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,848 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,849 INFO [Listener at localhost/34429] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 10:10:20,849 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 10:10:20,849 INFO [Listener at localhost/34429] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 10:10:20,849 INFO [Listener at localhost/34429] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 10:10:20,851 INFO [Listener at localhost/34429] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43767 2023-07-19 10:10:20,852 INFO [Listener at localhost/34429] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 10:10:20,855 INFO [Listener at localhost/34429] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 10:10:20,856 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,857 INFO [Listener at localhost/34429] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:20,858 INFO [Listener at localhost/34429] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43767 connecting to ZooKeeper ensemble=127.0.0.1:54485 2023-07-19 10:10:20,862 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:437670x0, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 10:10:20,863 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:437670x0, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:10:20,864 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:437670x0, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:10:20,865 DEBUG [Listener at localhost/34429] zookeeper.ZKUtil(164): regionserver:437670x0, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 10:10:20,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43767-0x1017d0f8e5b0003 connected 2023-07-19 10:10:20,874 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43767 2023-07-19 10:10:20,875 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43767 2023-07-19 10:10:20,878 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43767 2023-07-19 10:10:20,881 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43767 2023-07-19 10:10:20,881 DEBUG [Listener at localhost/34429] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43767 2023-07-19 10:10:20,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:20,895 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 10:10:20,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:20,920 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,920 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,920 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,920 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 10:10:20,921 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:20,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 10:10:20,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38127,1689761419092 from backup master directory 2023-07-19 10:10:20,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 10:10:20,929 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:20,929 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 10:10:20,930 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:20,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:20,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 10:10:20,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 10:10:21,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/hbase.id with ID: 91416110-3559-4d6f-b203-31c7af47ea30 2023-07-19 10:10:21,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 10:10:21,163 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:21,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x626a2b36 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:21,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@99eaa05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:21,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:21,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 10:10:21,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 10:10:21,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 10:10:21,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 10:10:21,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 10:10:21,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:21,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store-tmp 2023-07-19 10:10:21,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:21,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 10:10:21,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 10:10:21,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:10:21,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 10:10:21,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/WALs/jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:21,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38127%2C1689761419092, suffix=, logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/WALs/jenkins-hbase4.apache.org,38127,1689761419092, archiveDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/oldWALs, maxLogs=10 2023-07-19 10:10:21,583 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK] 2023-07-19 10:10:21,583 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK] 2023-07-19 10:10:21,583 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK] 2023-07-19 10:10:21,600 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 10:10:21,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/WALs/jenkins-hbase4.apache.org,38127,1689761419092/jenkins-hbase4.apache.org%2C38127%2C1689761419092.1689761421517 2023-07-19 10:10:21,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK], DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK], DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK]] 2023-07-19 10:10:21,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:21,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:21,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,803 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,811 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 10:10:21,842 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 10:10:21,857 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:21,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 10:10:21,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:21,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72454647, jitterRate=0.0796583741903305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:21,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 10:10:21,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 10:10:21,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 10:10:21,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 10:10:21,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 10:10:21,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 10:10:21,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-07-19 10:10:21,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 10:10:21,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 10:10:22,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 10:10:22,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 10:10:22,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 10:10:22,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 10:10:22,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 10:10:22,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 10:10:22,060 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 10:10:22,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 10:10:22,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 10:10:22,085 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,086 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,086 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,086 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 10:10:22,086 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38127,1689761419092, sessionid=0x1017d0f8e5b0000, setting cluster-up flag (Was=false) 2023-07-19 10:10:22,109 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 10:10:22,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:22,124 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:22,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 10:10:22,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:22,135 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp 2023-07-19 10:10:22,195 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(951): ClusterId : 91416110-3559-4d6f-b203-31c7af47ea30 2023-07-19 10:10:22,213 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 10:10:22,219 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(951): ClusterId : 91416110-3559-4d6f-b203-31c7af47ea30 2023-07-19 10:10:22,220 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(951): ClusterId : 91416110-3559-4d6f-b203-31c7af47ea30 2023-07-19 10:10:22,220 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 10:10:22,224 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 10:10:22,230 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 10:10:22,230 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 10:10:22,231 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 10:10:22,231 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 10:10:22,232 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 10:10:22,232 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 10:10:22,236 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 10:10:22,236 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 10:10:22,239 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ReadOnlyZKClient(139): Connect 0x03b1a199 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:22,240 DEBUG [RS:2;jenkins-hbase4:43767] zookeeper.ReadOnlyZKClient(139): Connect 0x7e33bcb9 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:22,243 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 10:10:22,247 DEBUG [RS:0;jenkins-hbase4:41773] zookeeper.ReadOnlyZKClient(139): Connect 0x5edf2809 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:22,275 DEBUG [RS:2;jenkins-hbase4:43767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70f45d0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:22,276 DEBUG [RS:2;jenkins-hbase4:43767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74cbd7c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:10:22,277 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d764f9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:22,277 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@949cae9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:10:22,278 DEBUG [RS:0;jenkins-hbase4:41773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5018cda2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:22,279 DEBUG [RS:0;jenkins-hbase4:41773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54274379, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:10:22,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 10:10:22,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 10:10:22,311 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41773 2023-07-19 10:10:22,312 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36483 2023-07-19 10:10:22,318 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43767 2023-07-19 10:10:22,320 INFO [RS:2;jenkins-hbase4:43767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 10:10:22,320 INFO [RS:2;jenkins-hbase4:43767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 10:10:22,320 INFO [RS:0;jenkins-hbase4:41773] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 10:10:22,323 INFO [RS:0;jenkins-hbase4:41773] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 10:10:22,323 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 10:10:22,323 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 10:10:22,329 INFO [RS:2;jenkins-hbase4:43767] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,335 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 10:10:22,330 INFO [RS:0;jenkins-hbase4:41773] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,330 INFO [RS:1;jenkins-hbase4:36483] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 10:10:22,336 INFO [RS:1;jenkins-hbase4:36483] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 10:10:22,336 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 10:10:22,336 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 10:10:22,336 INFO [RS:1;jenkins-hbase4:36483] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:22,337 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 10:10:22,338 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38127,1689761419092 with isa=jenkins-hbase4.apache.org/172.31.14.131:36483, startcode=1689761420784 2023-07-19 10:10:22,338 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38127,1689761419092 with isa=jenkins-hbase4.apache.org/172.31.14.131:43767, startcode=1689761420847 2023-07-19 10:10:22,338 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38127,1689761419092 with isa=jenkins-hbase4.apache.org/172.31.14.131:41773, startcode=1689761420713 2023-07-19 10:10:22,370 DEBUG [RS:0;jenkins-hbase4:41773] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 10:10:22,370 DEBUG [RS:2;jenkins-hbase4:43767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 10:10:22,371 DEBUG [RS:1;jenkins-hbase4:36483] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 10:10:22,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689761452475 2023-07-19 10:10:22,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 10:10:22,490 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 10:10:22,491 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 10:10:22,495 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41159, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 10:10:22,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 10:10:22,495 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59267, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 10:10:22,497 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:22,501 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60691, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 10:10:22,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 10:10:22,514 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38127] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 10:10:22,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 10:10:22,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 10:10:22,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 10:10:22,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 10:10:22,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 10:10:22,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 10:10:22,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 10:10:22,528 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38127] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 10:10:22,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 10:10:22,529 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38127] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 10:10:22,560 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 10:10:22,560 WARN [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 10:10:22,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689761422542,5,FailOnTimeoutGroup] 2023-07-19 10:10:22,575 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 10:10:22,575 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 10:10:22,576 WARN [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 10:10:22,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689761422576,5,FailOnTimeoutGroup] 2023-07-19 10:10:22,576 WARN [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 10:10:22,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 10:10:22,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,620 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:22,621 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:22,622 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:22,661 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:22,661 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38127,1689761419092 with isa=jenkins-hbase4.apache.org/172.31.14.131:41773, startcode=1689761420713 2023-07-19 10:10:22,669 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 10:10:22,672 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38127] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,677 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/info 2023-07-19 10:10:22,678 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38127,1689761419092 with isa=jenkins-hbase4.apache.org/172.31.14.131:43767, startcode=1689761420847 2023-07-19 10:10:22,678 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38127,1689761419092 with isa=jenkins-hbase4.apache.org/172.31.14.131:36483, startcode=1689761420784 2023-07-19 10:10:22,678 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 10:10:22,682 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38127] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,682 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:22,683 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 10:10:22,683 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:22,683 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36553 2023-07-19 10:10:22,683 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 10:10:22,683 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38127] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,684 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:22,685 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36553 2023-07-19 10:10:22,685 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 10:10:22,686 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:22,686 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36553 2023-07-19 10:10:22,686 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 10:10:22,688 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/rep_barrier 2023-07-19 10:10:22,689 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 10:10:22,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:22,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 10:10:22,692 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:10:22,697 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,697 WARN [RS:1;jenkins-hbase4:36483] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:22,697 INFO [RS:1;jenkins-hbase4:36483] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:22,697 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,703 DEBUG [RS:2;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,703 DEBUG [RS:0;jenkins-hbase4:41773] zookeeper.ZKUtil(162): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,703 WARN [RS:2;jenkins-hbase4:43767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:22,703 WARN [RS:0;jenkins-hbase4:41773] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 10:10:22,707 INFO [RS:0;jenkins-hbase4:41773] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:22,707 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,704 INFO [RS:2;jenkins-hbase4:43767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:22,708 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,709 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41773,1689761420713] 2023-07-19 10:10:22,709 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43767,1689761420847] 2023-07-19 10:10:22,709 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36483,1689761420784] 2023-07-19 10:10:22,713 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,713 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,714 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/table 2023-07-19 10:10:22,722 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 10:10:22,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:22,729 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740 2023-07-19 10:10:22,730 DEBUG [RS:0;jenkins-hbase4:41773] zookeeper.ZKUtil(162): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,737 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740 2023-07-19 10:10:22,737 DEBUG [RS:0;jenkins-hbase4:41773] zookeeper.ZKUtil(162): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,737 DEBUG [RS:0;jenkins-hbase4:41773] zookeeper.ZKUtil(162): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,743 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 10:10:22,748 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 10:10:22,748 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 10:10:22,753 DEBUG [RS:2;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,753 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 10:10:22,753 DEBUG [RS:2;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,754 DEBUG [RS:2;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,757 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 10:10:22,765 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:22,765 INFO [RS:2;jenkins-hbase4:43767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 10:10:22,767 INFO [RS:0;jenkins-hbase4:41773] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 10:10:22,767 INFO [RS:1;jenkins-hbase4:36483] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 10:10:22,770 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69637278, jitterRate=0.03767630457878113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 10:10:22,770 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 10:10:22,770 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 10:10:22,771 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 10:10:22,771 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 10:10:22,771 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 10:10:22,771 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 10:10:22,773 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 10:10:22,773 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 10:10:22,784 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 10:10:22,784 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 10:10:22,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 10:10:22,813 INFO [RS:0;jenkins-hbase4:41773] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 10:10:22,831 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 10:10:22,831 INFO [RS:1;jenkins-hbase4:36483] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 10:10:22,835 INFO [RS:2;jenkins-hbase4:43767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 10:10:22,838 INFO [RS:0;jenkins-hbase4:41773] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 10:10:22,838 INFO [RS:2;jenkins-hbase4:43767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 10:10:22,839 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,838 INFO [RS:1;jenkins-hbase4:36483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 10:10:22,840 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 10:10:22,840 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,839 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,843 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 10:10:22,846 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 10:10:22,847 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 10:10:22,860 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,860 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,860 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,860 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,861 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,861 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,862 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,862 DEBUG [RS:2;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,866 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,869 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,870 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,870 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,870 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,870 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,870 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,870 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,870 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,871 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 10:10:22,871 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,871 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,871 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,871 DEBUG [RS:0;jenkins-hbase4:41773] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 10:10:22,874 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,874 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,874 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,875 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,875 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,878 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,896 INFO [RS:2;jenkins-hbase4:43767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 10:10:22,897 INFO [RS:1;jenkins-hbase4:36483] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 10:10:22,898 INFO [RS:0;jenkins-hbase4:41773] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 10:10:22,901 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36483,1689761420784-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,901 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41773,1689761420713-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,901 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43767,1689761420847-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:22,920 INFO [RS:0;jenkins-hbase4:41773] regionserver.Replication(203): jenkins-hbase4.apache.org,41773,1689761420713 started 2023-07-19 10:10:22,920 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41773,1689761420713, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41773, sessionid=0x1017d0f8e5b0001 2023-07-19 10:10:22,920 INFO [RS:1;jenkins-hbase4:36483] regionserver.Replication(203): jenkins-hbase4.apache.org,36483,1689761420784 started 2023-07-19 10:10:22,920 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36483,1689761420784, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36483, sessionid=0x1017d0f8e5b0002 2023-07-19 10:10:22,920 INFO [RS:2;jenkins-hbase4:43767] regionserver.Replication(203): jenkins-hbase4.apache.org,43767,1689761420847 started 2023-07-19 10:10:22,921 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 10:10:22,921 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43767,1689761420847, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43767, sessionid=0x1017d0f8e5b0003 2023-07-19 10:10:22,921 DEBUG [RS:0;jenkins-hbase4:41773] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,920 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 10:10:22,921 DEBUG [RS:0;jenkins-hbase4:41773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41773,1689761420713' 2023-07-19 10:10:22,921 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 10:10:22,922 DEBUG [RS:0;jenkins-hbase4:41773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 10:10:22,921 DEBUG [RS:1;jenkins-hbase4:36483] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,922 DEBUG [RS:2;jenkins-hbase4:43767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,927 DEBUG [RS:2;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43767,1689761420847' 2023-07-19 10:10:22,923 DEBUG [RS:0;jenkins-hbase4:41773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 10:10:22,922 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36483,1689761420784' 2023-07-19 10:10:22,927 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 10:10:22,927 DEBUG [RS:2;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 10:10:22,928 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 10:10:22,928 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 10:10:22,928 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 10:10:22,928 DEBUG [RS:1;jenkins-hbase4:36483] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:22,928 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36483,1689761420784' 2023-07-19 10:10:22,928 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:22,929 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:22,929 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 10:10:22,929 INFO [RS:1;jenkins-hbase4:36483] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 10:10:22,929 INFO [RS:1;jenkins-hbase4:36483] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 10:10:22,933 DEBUG [RS:2;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 10:10:22,933 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 10:10:22,933 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 10:10:22,933 DEBUG [RS:0;jenkins-hbase4:41773] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:22,934 DEBUG [RS:0;jenkins-hbase4:41773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41773,1689761420713' 2023-07-19 10:10:22,934 DEBUG [RS:0;jenkins-hbase4:41773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:22,934 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 10:10:22,934 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 10:10:22,934 DEBUG [RS:2;jenkins-hbase4:43767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:22,935 DEBUG [RS:2;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43767,1689761420847' 2023-07-19 10:10:22,935 DEBUG [RS:2;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:22,935 DEBUG [RS:2;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:22,936 DEBUG [RS:2;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 10:10:22,936 INFO [RS:2;jenkins-hbase4:43767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 10:10:22,937 INFO [RS:2;jenkins-hbase4:43767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 10:10:22,938 DEBUG [RS:0;jenkins-hbase4:41773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:22,939 DEBUG [RS:0;jenkins-hbase4:41773] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 10:10:22,939 INFO [RS:0;jenkins-hbase4:41773] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 10:10:22,939 INFO [RS:0;jenkins-hbase4:41773] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 10:10:22,998 DEBUG [jenkins-hbase4:38127] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 10:10:23,004 DEBUG [jenkins-hbase4:38127] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:23,012 DEBUG [jenkins-hbase4:38127] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:23,012 DEBUG [jenkins-hbase4:38127] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:23,012 DEBUG [jenkins-hbase4:38127] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:23,012 DEBUG [jenkins-hbase4:38127] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:23,015 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43767,1689761420847, state=OPENING 2023-07-19 10:10:23,022 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 10:10:23,024 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:23,024 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 10:10:23,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:10:23,043 INFO [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43767%2C1689761420847, suffix=, logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,43767,1689761420847, archiveDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs, maxLogs=32 2023-07-19 10:10:23,064 INFO [RS:0;jenkins-hbase4:41773] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41773%2C1689761420713, suffix=, logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,41773,1689761420713, archiveDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs, maxLogs=32 2023-07-19 10:10:23,089 INFO [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36483%2C1689761420784, suffix=, logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,36483,1689761420784, archiveDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs, maxLogs=32 2023-07-19 10:10:23,123 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK] 2023-07-19 10:10:23,125 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK] 2023-07-19 10:10:23,125 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK] 2023-07-19 10:10:23,142 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK] 2023-07-19 10:10:23,142 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK] 2023-07-19 10:10:23,142 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK] 2023-07-19 10:10:23,143 INFO [RS:0;jenkins-hbase4:41773] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,41773,1689761420713/jenkins-hbase4.apache.org%2C41773%2C1689761420713.1689761423077 2023-07-19 10:10:23,147 DEBUG [RS:0;jenkins-hbase4:41773] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK], DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK], DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK]] 2023-07-19 10:10:23,153 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK] 2023-07-19 10:10:23,153 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK] 2023-07-19 10:10:23,153 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK] 2023-07-19 10:10:23,172 INFO [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,36483,1689761420784/jenkins-hbase4.apache.org%2C36483%2C1689761420784.1689761423095 2023-07-19 10:10:23,173 DEBUG [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK], DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK], DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK]] 2023-07-19 10:10:23,175 INFO [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,43767,1689761420847/jenkins-hbase4.apache.org%2C43767%2C1689761420847.1689761423051 2023-07-19 10:10:23,175 DEBUG [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK], DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK], DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK]] 2023-07-19 10:10:23,294 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:23,297 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:10:23,300 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:10:23,324 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 10:10:23,325 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 10:10:23,330 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43767%2C1689761420847.meta, suffix=.meta, logDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,43767,1689761420847, archiveDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs, maxLogs=32 2023-07-19 10:10:23,358 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK] 2023-07-19 10:10:23,364 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK] 2023-07-19 10:10:23,364 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK] 2023-07-19 10:10:23,402 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/WALs/jenkins-hbase4.apache.org,43767,1689761420847/jenkins-hbase4.apache.org%2C43767%2C1689761420847.meta.1689761423331.meta 2023-07-19 10:10:23,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46103,DS-5e7c31c4-102c-4525-a2a7-7bed62ae98fd,DISK], DatanodeInfoWithStorage[127.0.0.1:43005,DS-79d9265f-1fb0-4e51-8c8e-d272e3e7d32b,DISK], DatanodeInfoWithStorage[127.0.0.1:46665,DS-b829176d-e948-4c57-9cbf-464d1dbf8c15,DISK]] 2023-07-19 10:10:23,412 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:23,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 10:10:23,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:23,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 10:10:23,418 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 10:10:23,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 10:10:23,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 10:10:23,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:23,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 10:10:23,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 10:10:23,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 10:10:23,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/info 2023-07-19 10:10:23,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/info 2023-07-19 10:10:23,444 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 10:10:23,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:23,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 10:10:23,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/rep_barrier 2023-07-19 10:10:23,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/rep_barrier 2023-07-19 10:10:23,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 10:10:23,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:23,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 10:10:23,453 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/table 2023-07-19 10:10:23,453 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/table 2023-07-19 10:10:23,453 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 10:10:23,454 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:23,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740 2023-07-19 10:10:23,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740 2023-07-19 10:10:23,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 10:10:23,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 10:10:23,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67696589, jitterRate=0.008757784962654114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 10:10:23,478 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 10:10:23,495 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689761423282 2023-07-19 10:10:23,522 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 10:10:23,523 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 10:10:23,527 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43767,1689761420847, state=OPEN 2023-07-19 10:10:23,530 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 10:10:23,530 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 10:10:23,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 10:10:23,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43767,1689761420847 in 501 msec 2023-07-19 10:10:23,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 10:10:23,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 742 msec 2023-07-19 10:10:23,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2540 sec 2023-07-19 10:10:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689761423555, completionTime=-1 2023-07-19 10:10:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 10:10:23,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 10:10:23,644 DEBUG [hconnection-0x6241c47d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:23,648 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:23,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 10:10:23,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689761483672 2023-07-19 10:10:23,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689761543672 2023-07-19 10:10:23,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 116 msec 2023-07-19 10:10:23,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38127,1689761419092-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38127,1689761419092-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38127,1689761419092-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38127, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 10:10:23,717 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 10:10:23,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 10:10:23,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:23,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 10:10:23,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:23,756 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:23,782 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:23,786 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6 empty. 2023-07-19 10:10:23,787 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:23,787 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 10:10:23,835 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:23,838 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => fd90fef8cb70bd655d900a49dad7d7e6, NAME => 'hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:10:23,863 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:23,863 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing fd90fef8cb70bd655d900a49dad7d7e6, disabling compactions & flushes 2023-07-19 10:10:23,863 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:23,863 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:23,863 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. after waiting 0 ms 2023-07-19 10:10:23,863 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:23,863 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:23,863 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for fd90fef8cb70bd655d900a49dad7d7e6: 2023-07-19 10:10:23,869 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:23,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689761423872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761423872"}]},"ts":"1689761423872"} 2023-07-19 10:10:23,914 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 10:10:23,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:23,921 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761423917"}]},"ts":"1689761423917"} 2023-07-19 10:10:23,928 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 10:10:23,933 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:23,935 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:23,935 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:23,935 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:23,935 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:23,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fd90fef8cb70bd655d900a49dad7d7e6, ASSIGN}] 2023-07-19 10:10:23,946 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fd90fef8cb70bd655d900a49dad7d7e6, ASSIGN 2023-07-19 10:10:23,948 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fd90fef8cb70bd655d900a49dad7d7e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:10:24,101 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 10:10:24,102 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fd90fef8cb70bd655d900a49dad7d7e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:24,102 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689761424102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761424102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761424102"}]},"ts":"1689761424102"} 2023-07-19 10:10:24,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fd90fef8cb70bd655d900a49dad7d7e6, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:10:24,261 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:24,262 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:10:24,265 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:10:24,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:24,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd90fef8cb70bd655d900a49dad7d7e6, NAME => 'hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:24,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. service=AccessControlService 2023-07-19 10:10:24,274 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:24,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:24,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,277 INFO [StoreOpener-fd90fef8cb70bd655d900a49dad7d7e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,279 DEBUG [StoreOpener-fd90fef8cb70bd655d900a49dad7d7e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/info 2023-07-19 10:10:24,279 DEBUG [StoreOpener-fd90fef8cb70bd655d900a49dad7d7e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/info 2023-07-19 10:10:24,280 INFO [StoreOpener-fd90fef8cb70bd655d900a49dad7d7e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd90fef8cb70bd655d900a49dad7d7e6 columnFamilyName info 2023-07-19 10:10:24,281 INFO [StoreOpener-fd90fef8cb70bd655d900a49dad7d7e6-1] regionserver.HStore(310): Store=fd90fef8cb70bd655d900a49dad7d7e6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:24,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,283 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:10:24,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:24,291 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd90fef8cb70bd655d900a49dad7d7e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59471167, jitterRate=-0.11381055414676666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:24,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd90fef8cb70bd655d900a49dad7d7e6: 2023-07-19 10:10:24,293 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6., pid=6, masterSystemTime=1689761424261 2023-07-19 10:10:24,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:24,298 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:10:24,300 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fd90fef8cb70bd655d900a49dad7d7e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:24,300 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689761424299"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761424299"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761424299"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761424299"}]},"ts":"1689761424299"} 2023-07-19 10:10:24,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 10:10:24,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fd90fef8cb70bd655d900a49dad7d7e6, server=jenkins-hbase4.apache.org,41773,1689761420713 in 198 msec 2023-07-19 10:10:24,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 10:10:24,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fd90fef8cb70bd655d900a49dad7d7e6, ASSIGN in 369 msec 2023-07-19 10:10:24,313 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:24,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761424313"}]},"ts":"1689761424313"} 2023-07-19 10:10:24,315 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 10:10:24,318 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:24,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 582 msec 2023-07-19 10:10:24,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 10:10:24,353 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 10:10:24,353 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:24,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:24,384 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:24,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 10:10:24,421 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 10:10:24,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-19 10:10:24,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 10:10:24,450 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 10:10:24,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-19 10:10:24,473 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 10:10:24,476 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 10:10:24,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.546sec 2023-07-19 10:10:24,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 10:10:24,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 10:10:24,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 10:10:24,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38127,1689761419092-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 10:10:24,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38127,1689761419092-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 10:10:24,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 10:10:24,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 10:10:24,511 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:24,514 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:24,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 10:10:24,517 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:24,518 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c empty. 2023-07-19 10:10:24,521 DEBUG [Listener at localhost/34429] zookeeper.ReadOnlyZKClient(139): Connect 0x5356fd15 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:24,524 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:24,524 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 10:10:24,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:24,529 DEBUG [Listener at localhost/34429] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ff4f668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:24,557 DEBUG [hconnection-0x50c81d15-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:24,570 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:24,580 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/test.cache.data in system properties and HBase conf 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop.log.dir in system properties and HBase conf 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 10:10:24,584 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/nfs.dump.dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 10:10:24,585 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 10:10:24,586 INFO [Listener at localhost/34429] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 10:10:24,587 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 17c19d636c7e5ca20c5d489740ed661c, NAME => 'hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:10:24,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:24,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 17c19d636c7e5ca20c5d489740ed661c, disabling compactions & flushes 2023-07-19 10:10:24,629 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:24,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:24,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. after waiting 0 ms 2023-07-19 10:10:24,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:24,630 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:24,630 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 17c19d636c7e5ca20c5d489740ed661c: 2023-07-19 10:10:24,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:24,642 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:24,648 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689761424647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761424647"}]},"ts":"1689761424647"} 2023-07-19 10:10:24,663 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 10:10:24,668 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:24,668 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761424668"}]},"ts":"1689761424668"} 2023-07-19 10:10:24,671 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 10:10:24,679 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:24,681 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:24,681 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:24,681 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:24,681 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:24,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=17c19d636c7e5ca20c5d489740ed661c, ASSIGN}] 2023-07-19 10:10:24,686 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=17c19d636c7e5ca20c5d489740ed661c, ASSIGN 2023-07-19 10:10:24,688 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=17c19d636c7e5ca20c5d489740ed661c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:10:24,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:24,838 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 10:10:24,839 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=17c19d636c7e5ca20c5d489740ed661c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:24,840 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689761424839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761424839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761424839"}]},"ts":"1689761424839"} 2023-07-19 10:10:24,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 17c19d636c7e5ca20c5d489740ed661c, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:10:25,008 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:25,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17c19d636c7e5ca20c5d489740ed661c, NAME => 'hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:10:25,009 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. service=AccessControlService 2023-07-19 10:10:25,010 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:25,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:25,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,012 INFO [StoreOpener-17c19d636c7e5ca20c5d489740ed661c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,017 DEBUG [StoreOpener-17c19d636c7e5ca20c5d489740ed661c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/l 2023-07-19 10:10:25,019 DEBUG [StoreOpener-17c19d636c7e5ca20c5d489740ed661c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/l 2023-07-19 10:10:25,020 INFO [StoreOpener-17c19d636c7e5ca20c5d489740ed661c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17c19d636c7e5ca20c5d489740ed661c columnFamilyName l 2023-07-19 10:10:25,022 INFO [StoreOpener-17c19d636c7e5ca20c5d489740ed661c-1] regionserver.HStore(310): Store=17c19d636c7e5ca20c5d489740ed661c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:25,025 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:10:25,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:25,038 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17c19d636c7e5ca20c5d489740ed661c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72136104, jitterRate=0.07491171360015869}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:25,039 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17c19d636c7e5ca20c5d489740ed661c: 2023-07-19 10:10:25,041 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c., pid=11, masterSystemTime=1689761425002 2023-07-19 10:10:25,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:25,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:10:25,046 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=17c19d636c7e5ca20c5d489740ed661c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:25,046 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689761425046"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761425046"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761425046"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761425046"}]},"ts":"1689761425046"} 2023-07-19 10:10:25,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 10:10:25,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 17c19d636c7e5ca20c5d489740ed661c, server=jenkins-hbase4.apache.org,41773,1689761420713 in 208 msec 2023-07-19 10:10:25,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 10:10:25,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=17c19d636c7e5ca20c5d489740ed661c, ASSIGN in 380 msec 2023-07-19 10:10:25,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:25,069 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761425069"}]},"ts":"1689761425069"} 2023-07-19 10:10:25,073 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 10:10:25,081 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:25,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 575 msec 2023-07-19 10:10:25,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 10:10:25,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 10:10:25,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 10:10:26,058 WARN [Thread-381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:26,476 INFO [Thread-381] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:26,483 INFO [Thread-381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37093_jobhistory____ls9hcf/webapp 2023-07-19 10:10:26,688 INFO [Thread-381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 10:10:26,689 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:26,689 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:26,692 INFO [Thread-381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:26,796 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:27,165 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:27,734 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 10:10:27,822 INFO [Thread-381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37093 2023-07-19 10:10:28,990 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:10:29,268 WARN [Listener at jenkins-hbase4.apache.org/46419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:29,337 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 10:10:29,339 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 10:10:29,341 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 10:10:29,342 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:29,343 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 10:10:29,343 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:29,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 10:10:29,344 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 10:10:29,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 10:10:29,344 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:29,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 10:10:29,344 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 10:10:29,344 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 10:10:29,392 WARN [Listener at jenkins-hbase4.apache.org/46419] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 10:10:29,393 INFO [Listener at jenkins-hbase4.apache.org/46419] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:29,417 INFO [Listener at jenkins-hbase4.apache.org/46419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43521_cluster____.7qgn2p/webapp 2023-07-19 10:10:29,505 INFO [Listener at jenkins-hbase4.apache.org/46419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:29,505 INFO [Listener at jenkins-hbase4.apache.org/46419] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 10:10:29,505 INFO [Listener at jenkins-hbase4.apache.org/46419] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:29,506 INFO [Listener at jenkins-hbase4.apache.org/46419] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:29,517 INFO [Listener at jenkins-hbase4.apache.org/46419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:29,744 INFO [Listener at jenkins-hbase4.apache.org/46419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:29,877 INFO [Listener at jenkins-hbase4.apache.org/46419] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:29,888 INFO [Listener at jenkins-hbase4.apache.org/46419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43521 2023-07-19 10:10:30,322 WARN [Listener at jenkins-hbase4.apache.org/33585] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:30,348 WARN [Listener at jenkins-hbase4.apache.org/33585] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 10:10:30,348 INFO [Listener at jenkins-hbase4.apache.org/33585] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:30,360 INFO [Listener at jenkins-hbase4.apache.org/33585] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36573_node____gkzn4c/webapp 2023-07-19 10:10:30,437 INFO [Listener at jenkins-hbase4.apache.org/33585] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 10:10:30,438 INFO [Listener at jenkins-hbase4.apache.org/33585] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:30,438 INFO [Listener at jenkins-hbase4.apache.org/33585] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:30,438 INFO [Listener at jenkins-hbase4.apache.org/33585] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:30,451 INFO [Listener at jenkins-hbase4.apache.org/33585] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,482 INFO [Listener at jenkins-hbase4.apache.org/33585] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,581 INFO [Listener at jenkins-hbase4.apache.org/33585] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,597 INFO [Listener at jenkins-hbase4.apache.org/33585] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36573 2023-07-19 10:10:30,849 WARN [Listener at jenkins-hbase4.apache.org/43315] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 10:10:30,857 WARN [Listener at jenkins-hbase4.apache.org/43315] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 10:10:30,857 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 10:10:30,865 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40059_node____.pc6tpm/webapp 2023-07-19 10:10:30,930 INFO [Listener at jenkins-hbase4.apache.org/43315] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 10:10:30,930 INFO [Listener at jenkins-hbase4.apache.org/43315] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 10:10:30,931 INFO [Listener at jenkins-hbase4.apache.org/43315] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 10:10:30,931 INFO [Listener at jenkins-hbase4.apache.org/43315] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 10:10:30,941 INFO [Listener at jenkins-hbase4.apache.org/43315] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:30,964 INFO [Listener at jenkins-hbase4.apache.org/43315] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:31,042 INFO [Listener at jenkins-hbase4.apache.org/43315] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 10:10:31,048 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40059 2023-07-19 10:10:31,079 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 10:10:31,081 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:31,159 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=175, AvailableMemoryMB=4906 2023-07-19 10:10:31,159 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-19 10:10:31,174 DEBUG [Listener at jenkins-hbase4.apache.org/43315] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 10:10:31,180 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 10:10:31,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 10:10:31,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:31,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:31,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 10:10:31,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,198 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:31,203 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 empty. 2023-07-19 10:10:31,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,208 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,209 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 empty. 2023-07-19 10:10:31,211 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,211 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 10:10:31,250 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:31,252 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => cce676c601baa7bb50f1c8002585dfc3, NAME => 'testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:10:31,256 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 32d38cb5e9a08c15732478f71e48cbf8, NAME => 'testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:10:31,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,327 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,328 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing cce676c601baa7bb50f1c8002585dfc3, disabling compactions & flushes 2023-07-19 10:10:31,328 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 32d38cb5e9a08c15732478f71e48cbf8, disabling compactions & flushes 2023-07-19 10:10:31,328 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,328 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. after waiting 0 ms 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. after waiting 0 ms 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,329 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,329 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for cce676c601baa7bb50f1c8002585dfc3: 2023-07-19 10:10:31,329 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 32d38cb5e9a08c15732478f71e48cbf8: 2023-07-19 10:10:31,333 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:31,334 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761431334"}]},"ts":"1689761431334"} 2023-07-19 10:10:31,335 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761431334"}]},"ts":"1689761431334"} 2023-07-19 10:10:31,387 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:10:31,388 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:31,388 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761431388"}]},"ts":"1689761431388"} 2023-07-19 10:10:31,390 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 10:10:31,395 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:31,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:31,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:31,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:31,397 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:31,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, ASSIGN}] 2023-07-19 10:10:31,400 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, ASSIGN 2023-07-19 10:10:31,400 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, ASSIGN 2023-07-19 10:10:31,402 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1689761420784; forceNewPlan=false, retain=false 2023-07-19 10:10:31,402 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:10:31,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,552 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:10:31,554 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cce676c601baa7bb50f1c8002585dfc3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:31,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=32d38cb5e9a08c15732478f71e48cbf8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:31,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761431554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761431554"}]},"ts":"1689761431554"} 2023-07-19 10:10:31,555 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761431554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761431554"}]},"ts":"1689761431554"} 2023-07-19 10:10:31,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 32d38cb5e9a08c15732478f71e48cbf8, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:10:31,559 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure cce676c601baa7bb50f1c8002585dfc3, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:10:31,715 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:31,715 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:10:31,724 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:10:31,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 32d38cb5e9a08c15732478f71e48cbf8, NAME => 'testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:10:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. service=AccessControlService 2023-07-19 10:10:31,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,744 INFO [StoreOpener-32d38cb5e9a08c15732478f71e48cbf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cce676c601baa7bb50f1c8002585dfc3, NAME => 'testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:10:31,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. service=AccessControlService 2023-07-19 10:10:31,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,753 DEBUG [StoreOpener-32d38cb5e9a08c15732478f71e48cbf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf 2023-07-19 10:10:31,753 DEBUG [StoreOpener-32d38cb5e9a08c15732478f71e48cbf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf 2023-07-19 10:10:31,755 INFO [StoreOpener-cce676c601baa7bb50f1c8002585dfc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,757 INFO [StoreOpener-32d38cb5e9a08c15732478f71e48cbf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32d38cb5e9a08c15732478f71e48cbf8 columnFamilyName cf 2023-07-19 10:10:31,758 DEBUG [StoreOpener-cce676c601baa7bb50f1c8002585dfc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf 2023-07-19 10:10:31,758 DEBUG [StoreOpener-cce676c601baa7bb50f1c8002585dfc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf 2023-07-19 10:10:31,759 INFO [StoreOpener-cce676c601baa7bb50f1c8002585dfc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cce676c601baa7bb50f1c8002585dfc3 columnFamilyName cf 2023-07-19 10:10:31,760 INFO [StoreOpener-32d38cb5e9a08c15732478f71e48cbf8-1] regionserver.HStore(310): Store=32d38cb5e9a08c15732478f71e48cbf8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:31,762 INFO [StoreOpener-cce676c601baa7bb50f1c8002585dfc3-1] regionserver.HStore(310): Store=cce676c601baa7bb50f1c8002585dfc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:31,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:31,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:31,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:31,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:31,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cce676c601baa7bb50f1c8002585dfc3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74802231, jitterRate=0.11464010179042816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:31,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cce676c601baa7bb50f1c8002585dfc3: 2023-07-19 10:10:31,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 32d38cb5e9a08c15732478f71e48cbf8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71723490, jitterRate=0.06876328587532043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:31,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 32d38cb5e9a08c15732478f71e48cbf8: 2023-07-19 10:10:31,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3., pid=16, masterSystemTime=1689761431715 2023-07-19 10:10:31,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8., pid=15, masterSystemTime=1689761431711 2023-07-19 10:10:31,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:31,797 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=32d38cb5e9a08c15732478f71e48cbf8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:31,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:31,798 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761431797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761431797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761431797"}]},"ts":"1689761431797"} 2023-07-19 10:10:31,799 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cce676c601baa7bb50f1c8002585dfc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:31,799 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761431799"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761431799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761431799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761431799"}]},"ts":"1689761431799"} 2023-07-19 10:10:31,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-19 10:10:31,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 32d38cb5e9a08c15732478f71e48cbf8, server=jenkins-hbase4.apache.org,41773,1689761420713 in 243 msec 2023-07-19 10:10:31,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-19 10:10:31,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure cce676c601baa7bb50f1c8002585dfc3, server=jenkins-hbase4.apache.org,36483,1689761420784 in 244 msec 2023-07-19 10:10:31,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 10:10:31,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, ASSIGN in 411 msec 2023-07-19 10:10:31,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, ASSIGN in 413 msec 2023-07-19 10:10:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:31,818 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:31,818 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761431818"}]},"ts":"1689761431818"} 2023-07-19 10:10:31,824 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 10:10:31,827 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:31,834 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 10:10:31,845 DEBUG [hconnection-0x4f8c8e23-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:31,850 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-19 10:10:31,858 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 10:10:31,889 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,889 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,889 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:10:31,889 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,890 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:31,900 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:31,900 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:31,900 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:31,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:31,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 718 msec 2023-07-19 10:10:32,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 10:10:32,319 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 10:10:32,323 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 10:10:32,324 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:32,326 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:32,354 DEBUG [hconnection-0x50c81d15-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,368 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,375 DEBUG [hconnection-0x50c81d15-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,379 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:32,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761432404 (current time:1689761432404). 2023-07-19 10:10:32,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:32,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x0f8075b3 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:32,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ac6a0af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:32,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,416 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f8075b3 to 127.0.0.1:54485 2023-07-19 10:10:32,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:32,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x1f492a37 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:32,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@701c15f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:32,433 DEBUG [hconnection-0x2b07ebc8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,437 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:32,445 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:32,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f492a37 to 127.0.0.1:54485 2023-07-19 10:10:32,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:32,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 10:10:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:32,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:32,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:32,514 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:32,526 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689762032526 2023-07-19 10:10:32,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:32,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 10:10:32,531 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:32,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:32,534 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:32,534 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:32,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 30 msec 2023-07-19 10:10:32,536 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:32,541 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689762032541 2023-07-19 10:10:32,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,572 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 10:10:32,572 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,573 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 10:10:32,573 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 10:10:32,574 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,574 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,579 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,579 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,579 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,579 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,580 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,580 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,581 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 10:10:32,581 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:32,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:32,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:32,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:32,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,589 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,589 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:32,591 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:32,592 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:32,592 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:32,593 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:32,593 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:32,592 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:32,593 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:32,593 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:32,595 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,596 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,596 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,596 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,596 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,596 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:32,597 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:32,601 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,602 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:32,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@691658c7[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:32,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@691658c7[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:32,608 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 10:10:32,609 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,613 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,613 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,613 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:32,613 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:32,613 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:10:32,613 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,613 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:32,616 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:32,628 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:32,629 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:32,629 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:32,630 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:32,630 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:32,630 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:32,630 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:32,630 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,630 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:32,630 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. started... 2023-07-19 10:10:32,631 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. started... 2023-07-19 10:10:32,638 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:32,640 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32d38cb5e9a08c15732478f71e48cbf8: 2023-07-19 10:10:32,640 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cce676c601baa7bb50f1c8002585dfc3: 2023-07-19 10:10:32,641 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,641 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:32,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:32,643 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:32,646 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:32,646 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:32,651 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:32,651 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:32,692 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. completed. 2023-07-19 10:10:32,693 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:32,694 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. completed. 2023-07-19 10:10:32,694 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:32,694 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:10:32,698 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,698 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:32,699 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 10:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:10:32,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 10:10:32,713 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 10:10:32,713 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:32,713 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:32,713 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,713 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:32,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,717 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,719 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,720 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,720 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:32,724 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,725 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,725 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,744 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,744 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:32,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,745 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:32,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 10:10:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,745 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:32,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:10:32,747 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:32,747 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,747 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:32,747 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:32,747 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,747 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:32,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 10:10:32,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,844 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:32,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:32,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:32,845 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:10:32,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 10:10:32,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,862 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:32,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689761432526Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689761432776 (+250 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689761432776Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689761432776Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689761432790 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689761432814 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689761432862 (+48 ms) 2023-07-19 10:10:32,864 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:32,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 336 msec 2023-07-19 10:10:33,145 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:33,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:33,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41773] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:33,179 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 10:10:33,179 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:33,179 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:33,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:33,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761433197 (current time:1689761433197). 2023-07-19 10:10:33,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:33,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x72d6a65d to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:33,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dba42b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:33,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,208 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72d6a65d to 127.0.0.1:54485 2023-07-19 10:10:33,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:33,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x6b54aefe to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:33,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cf71987, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:33,218 DEBUG [hconnection-0x377515d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,222 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:33,231 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:33,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b54aefe to 127.0.0.1:54485 2023-07-19 10:10:33,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 10:10:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:33,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:33,238 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:33,239 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689762033239 2023-07-19 10:10:33,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 10:10:33,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 10:10:33,241 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:33,241 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:33,242 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 10:10:33,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:33,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-19 10:10:33,244 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:33,245 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689762033245 2023-07-19 10:10:33,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 10:10:33,282 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 10:10:33,282 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,283 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 10:10:33,283 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 10:10:33,284 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,284 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,285 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,286 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,286 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 10:10:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 10:10:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,288 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:33,289 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:33,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,289 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:33,289 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,289 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,290 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,290 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,291 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,291 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:33,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 10:10:33,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 10:10:33,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 10:10:33,300 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:33,300 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:33,299 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:33,301 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 10:10:33,301 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:33,300 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:33,301 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 10:10:33,301 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:33,301 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 10:10:33,303 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,303 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,303 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,303 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:33,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:33,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:33,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de5b3f0[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 10:10:33,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de5b3f0[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:33,311 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 10:10:33,311 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:33,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,317 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:10:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:33,318 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:33,318 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,318 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. started... 2023-07-19 10:10:33,318 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:33,318 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:33,319 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. started... 2023-07-19 10:10:33,319 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 32d38cb5e9a08c15732478f71e48cbf8 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 10:10:33,319 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cce676c601baa7bb50f1c8002585dfc3 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 10:10:33,320 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:33,320 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,320 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:33,341 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:33,343 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:33,459 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719321d214bddcb4d99b686f3bb39f74d38 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230719321d214bddcb4d99b686f3bb39f74d38 2023-07-19 10:10:33,459 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307190793f64139aa46a5bf572b5429cecf11 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307190793f64139aa46a5bf572b5429cecf11 2023-07-19 10:10:33,492 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/.tmp/cf/7f79804260b54970a404ee4429e2504c 2023-07-19 10:10:33,493 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/.tmp/cf/d73c4710caa24041932fc0aeb4ab7677 2023-07-19 10:10:33,503 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/.tmp/cf/d73c4710caa24041932fc0aeb4ab7677 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf/d73c4710caa24041932fc0aeb4ab7677 2023-07-19 10:10:33,503 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/.tmp/cf/7f79804260b54970a404ee4429e2504c as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf/7f79804260b54970a404ee4429e2504c 2023-07-19 10:10:33,512 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf/d73c4710caa24041932fc0aeb4ab7677, entries=47, sequenceid=6, filesize=12.8 K 2023-07-19 10:10:33,514 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf/7f79804260b54970a404ee4429e2504c, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 10:10:33,517 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cce676c601baa7bb50f1c8002585dfc3 in 198ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:33,518 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 32d38cb5e9a08c15732478f71e48cbf8 in 198ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:33,518 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 10:10:33,518 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 10:10:33,521 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 32d38cb5e9a08c15732478f71e48cbf8: 2023-07-19 10:10:33,521 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cce676c601baa7bb50f1c8002585dfc3: 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf/7f79804260b54970a404ee4429e2504c] hfiles 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf/d73c4710caa24041932fc0aeb4ab7677] hfiles 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf/7f79804260b54970a404ee4429e2504c for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,522 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf/d73c4710caa24041932fc0aeb4ab7677 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,543 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:33,545 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:10:33,546 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. completed. 2023-07-19 10:10:33,546 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,547 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. completed. 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:33,547 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 10:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:10:33,549 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,549 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,549 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,549 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:33,550 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 10:10:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,551 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 10:10:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:10:33,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 10:10:33,559 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 10:10:33,559 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:33,559 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:33,560 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 10:10:33,560 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,562 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,562 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,563 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,564 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:33,567 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 10:10:33,567 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,567 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:33,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:33,578 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:33,578 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,579 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 10:10:33,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:33,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:33,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:10:33,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,579 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:33,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,580 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,580 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:33,580 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:33,580 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,580 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:33,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:33,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307190793f64139aa46a5bf572b5429cecf11, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230719321d214bddcb4d99b686f3bb39f74d38] mob files 2023-07-19 10:10:33,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307190793f64139aa46a5bf572b5429cecf11 2023-07-19 10:10:33,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230719321d214bddcb4d99b686f3bb39f74d38 2023-07-19 10:10:33,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 10:10:33,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,666 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 10:10:33,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,666 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 10:10:33,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689761433240Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689761433599 (+359 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689761433599Loading Region manifests for snaptb0-testExportWithTargetName at 1689761433599Writing data manifest for snaptb0-testExportWithTargetName at 1689761433605 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689761433619 (+14 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689761433666 (+47 ms) 2023-07-19 10:10:33,668 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 10:10:33,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 428 msec 2023-07-19 10:10:33,846 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:33,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 10:10:33,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:33,849 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849 2023-07-19 10:10:33,850 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36553, tgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849, rawTgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:33,895 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:33,896 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1430488961_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 10:10:33,896 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 10:10:33,920 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 10:10:34,001 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:34,002 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:34,002 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:34,003 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,026 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-4495316274377477468.jar 2023-07-19 10:10:35,027 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,028 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,099 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-1012457662604472184.jar 2023-07-19 10:10:35,099 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,100 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,100 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,101 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,102 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,102 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:35,103 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:10:35,104 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:10:35,104 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:10:35,105 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:10:35,106 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:10:35,107 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:10:35,107 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:10:35,108 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:10:35,108 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:10:35,109 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:10:35,114 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,115 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,116 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:35,116 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,117 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:35,117 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:35,118 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:36,146 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:10:36,159 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 10:10:36,170 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 10:10:36,768 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:36,769 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:36,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:37,246 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:10:42,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:44,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:47,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:49,171 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:10:49,173 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:10:49,187 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 10:10:49,188 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:10:49,188 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:10:49,189 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 10:10:49,189 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 10:10:49,189 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 10:10:49,190 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849/.hbase-snapshot/testExportWithTargetName 2023-07-19 10:10:49,190 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 10:10:49,190 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761433849/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 10:10:49,203 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 10:10:49,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 10:10:49,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,221 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761449221"}]},"ts":"1689761449221"} 2023-07-19 10:10:49,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 10:10:49,223 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 10:10:49,225 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 10:10:49,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, UNASSIGN}] 2023-07-19 10:10:49,229 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, UNASSIGN 2023-07-19 10:10:49,229 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, UNASSIGN 2023-07-19 10:10:49,230 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=32d38cb5e9a08c15732478f71e48cbf8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:49,230 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cce676c601baa7bb50f1c8002585dfc3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:49,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761449230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761449230"}]},"ts":"1689761449230"} 2023-07-19 10:10:49,230 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761449230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761449230"}]},"ts":"1689761449230"} 2023-07-19 10:10:49,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 32d38cb5e9a08c15732478f71e48cbf8, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:10:49,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure cce676c601baa7bb50f1c8002585dfc3, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:10:49,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 10:10:49,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:49,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 32d38cb5e9a08c15732478f71e48cbf8, disabling compactions & flushes 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cce676c601baa7bb50f1c8002585dfc3, disabling compactions & flushes 2023-07-19 10:10:49,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:49,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. after waiting 0 ms 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. after waiting 0 ms 2023-07-19 10:10:49,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:49,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:10:49,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:10:49,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:49,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8. 2023-07-19 10:10:49,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:10:49,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 32d38cb5e9a08c15732478f71e48cbf8: 2023-07-19 10:10:49,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3. 2023-07-19 10:10:49,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cce676c601baa7bb50f1c8002585dfc3: 2023-07-19 10:10:49,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:49,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:49,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cce676c601baa7bb50f1c8002585dfc3, regionState=CLOSED 2023-07-19 10:10:49,428 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449428"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761449428"}]},"ts":"1689761449428"} 2023-07-19 10:10:49,429 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=32d38cb5e9a08c15732478f71e48cbf8, regionState=CLOSED 2023-07-19 10:10:49,429 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689761449428"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761449428"}]},"ts":"1689761449428"} 2023-07-19 10:10:49,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 10:10:49,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 10:10:49,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure cce676c601baa7bb50f1c8002585dfc3, server=jenkins-hbase4.apache.org,36483,1689761420784 in 201 msec 2023-07-19 10:10:49,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 32d38cb5e9a08c15732478f71e48cbf8, server=jenkins-hbase4.apache.org,41773,1689761420713 in 204 msec 2023-07-19 10:10:49,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=32d38cb5e9a08c15732478f71e48cbf8, UNASSIGN in 222 msec 2023-07-19 10:10:49,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 10:10:49,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cce676c601baa7bb50f1c8002585dfc3, UNASSIGN in 223 msec 2023-07-19 10:10:49,452 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761449452"}]},"ts":"1689761449452"} 2023-07-19 10:10:49,454 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 10:10:49,456 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 10:10:49,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 246 msec 2023-07-19 10:10:49,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 10:10:49,530 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 10:10:49,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 10:10:49,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,544 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 10:10:49,546 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,550 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 10:10:49,552 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:49,552 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:49,556 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/recovered.edits] 2023-07-19 10:10:49,556 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/recovered.edits] 2023-07-19 10:10:49,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:49,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:49,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:49,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 10:10:49,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:49,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:49,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:49,561 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 10:10:49,561 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:49,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 10:10:49,564 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf/7f79804260b54970a404ee4429e2504c to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/cf/7f79804260b54970a404ee4429e2504c 2023-07-19 10:10:49,564 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf/d73c4710caa24041932fc0aeb4ab7677 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/cf/d73c4710caa24041932fc0aeb4ab7677 2023-07-19 10:10:49,571 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8/recovered.edits/9.seqid 2023-07-19 10:10:49,571 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3/recovered.edits/9.seqid 2023-07-19 10:10:49,572 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/32d38cb5e9a08c15732478f71e48cbf8 2023-07-19 10:10:49,572 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportWithTargetName/cce676c601baa7bb50f1c8002585dfc3 2023-07-19 10:10:49,572 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 10:10:49,573 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 10:10:49,574 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-19 10:10:49,578 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307190793f64139aa46a5bf572b5429cecf11 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307190793f64139aa46a5bf572b5429cecf11 2023-07-19 10:10:49,580 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230719321d214bddcb4d99b686f3bb39f74d38 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230719321d214bddcb4d99b686f3bb39f74d38 2023-07-19 10:10:49,580 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 10:10:49,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,607 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 10:10:49,610 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 10:10:49,612 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,612 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 10:10:49,613 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761449612"}]},"ts":"9223372036854775807"} 2023-07-19 10:10:49,613 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761449612"}]},"ts":"9223372036854775807"} 2023-07-19 10:10:49,617 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:10:49,617 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cce676c601baa7bb50f1c8002585dfc3, NAME => 'testtb-testExportWithTargetName,,1689761431187.cce676c601baa7bb50f1c8002585dfc3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 32d38cb5e9a08c15732478f71e48cbf8, NAME => 'testtb-testExportWithTargetName,1,1689761431187.32d38cb5e9a08c15732478f71e48cbf8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:10:49,617 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 10:10:49,617 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761449617"}]},"ts":"9223372036854775807"} 2023-07-19 10:10:49,620 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 10:10:49,622 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 10:10:49,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 86 msec 2023-07-19 10:10:49,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 10:10:49,667 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 10:10:49,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 10:10:49,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 10:10:49,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 10:10:49,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 10:10:49,730 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 704) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1243813200_1 at /127.0.0.1:36160 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:36182 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:52562 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1243813200_1 at /127.0.0.1:60822 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:42071 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:60832 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:40193 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=923 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=434 (was 299) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3101 (was 4906) 2023-07-19 10:10:49,730 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-19 10:10:49,756 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=434, ProcessCount=182, AvailableMemoryMB=3100 2023-07-19 10:10:49,756 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-19 10:10:49,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 10:10:49,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:10:49,765 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:10:49,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 10:10:49,767 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:10:49,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:49,770 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:49,770 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:49,770 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef empty. 2023-07-19 10:10:49,770 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 empty. 2023-07-19 10:10:49,771 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:49,771 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:49,771 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 10:10:49,788 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 10:10:49,789 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c505934e30de4ca11612da79b51acef, NAME => 'testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:10:49,789 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f035df7268d59f3f44cfb3c61cd1c74, NAME => 'testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:10:49,812 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:49,812 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5f035df7268d59f3f44cfb3c61cd1c74, disabling compactions & flushes 2023-07-19 10:10:49,812 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:49,812 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:49,812 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. after waiting 0 ms 2023-07-19 10:10:49,812 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:49,812 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:49,812 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5f035df7268d59f3f44cfb3c61cd1c74: 2023-07-19 10:10:49,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6c505934e30de4ca11612da79b51acef, disabling compactions & flushes 2023-07-19 10:10:50,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. after waiting 0 ms 2023-07-19 10:10:50,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6c505934e30de4ca11612da79b51acef: 2023-07-19 10:10:50,213 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:10:50,214 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450213"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761450213"}]},"ts":"1689761450213"} 2023-07-19 10:10:50,214 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450213"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761450213"}]},"ts":"1689761450213"} 2023-07-19 10:10:50,216 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:10:50,217 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:10:50,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761450218"}]},"ts":"1689761450218"} 2023-07-19 10:10:50,219 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 10:10:50,223 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:10:50,224 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:10:50,224 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:10:50,224 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:10:50,224 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:10:50,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, ASSIGN}] 2023-07-19 10:10:50,232 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, ASSIGN 2023-07-19 10:10:50,232 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, ASSIGN 2023-07-19 10:10:50,233 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:10:50,233 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1689761420784; forceNewPlan=false, retain=false 2023-07-19 10:10:50,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,383 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:10:50,386 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6c505934e30de4ca11612da79b51acef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:50,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5f035df7268d59f3f44cfb3c61cd1c74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:50,386 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761450386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761450386"}]},"ts":"1689761450386"} 2023-07-19 10:10:50,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450386"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761450386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761450386"}]},"ts":"1689761450386"} 2023-07-19 10:10:50,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 5f035df7268d59f3f44cfb3c61cd1c74, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:10:50,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6c505934e30de4ca11612da79b51acef, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:10:50,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c505934e30de4ca11612da79b51acef, NAME => 'testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:10:50,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. service=AccessControlService 2023-07-19 10:10:50,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:50,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f035df7268d59f3f44cfb3c61cd1c74, NAME => 'testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:10:50,551 INFO [StoreOpener-6c505934e30de4ca11612da79b51acef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. service=AccessControlService 2023-07-19 10:10:50,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:10:50,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:10:50,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,553 DEBUG [StoreOpener-6c505934e30de4ca11612da79b51acef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf 2023-07-19 10:10:50,553 DEBUG [StoreOpener-6c505934e30de4ca11612da79b51acef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf 2023-07-19 10:10:50,554 INFO [StoreOpener-6c505934e30de4ca11612da79b51acef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c505934e30de4ca11612da79b51acef columnFamilyName cf 2023-07-19 10:10:50,554 INFO [StoreOpener-5f035df7268d59f3f44cfb3c61cd1c74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,555 DEBUG [StoreOpener-5f035df7268d59f3f44cfb3c61cd1c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf 2023-07-19 10:10:50,556 INFO [StoreOpener-6c505934e30de4ca11612da79b51acef-1] regionserver.HStore(310): Store=6c505934e30de4ca11612da79b51acef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:50,556 DEBUG [StoreOpener-5f035df7268d59f3f44cfb3c61cd1c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf 2023-07-19 10:10:50,557 INFO [StoreOpener-5f035df7268d59f3f44cfb3c61cd1c74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f035df7268d59f3f44cfb3c61cd1c74 columnFamilyName cf 2023-07-19 10:10:50,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,559 INFO [StoreOpener-5f035df7268d59f3f44cfb3c61cd1c74-1] regionserver.HStore(310): Store=5f035df7268d59f3f44cfb3c61cd1c74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:10:50,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c505934e30de4ca11612da79b51acef 2023-07-19 10:10:50,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:10:50,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:50,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c505934e30de4ca11612da79b51acef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68570747, jitterRate=0.021783754229545593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:50,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c505934e30de4ca11612da79b51acef: 2023-07-19 10:10:50,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef., pid=31, masterSystemTime=1689761450542 2023-07-19 10:10:50,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:10:50,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f035df7268d59f3f44cfb3c61cd1c74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59151192, jitterRate=-0.11857855319976807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:10:50,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f035df7268d59f3f44cfb3c61cd1c74: 2023-07-19 10:10:50,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74., pid=30, masterSystemTime=1689761450542 2023-07-19 10:10:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6c505934e30de4ca11612da79b51acef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:50,575 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761450575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761450575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761450575"}]},"ts":"1689761450575"} 2023-07-19 10:10:50,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:50,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:50,577 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5f035df7268d59f3f44cfb3c61cd1c74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:50,577 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761450577"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761450577"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761450577"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761450577"}]},"ts":"1689761450577"} 2023-07-19 10:10:50,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 10:10:50,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6c505934e30de4ca11612da79b51acef, server=jenkins-hbase4.apache.org,41773,1689761420713 in 189 msec 2023-07-19 10:10:50,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 10:10:50,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 5f035df7268d59f3f44cfb3c61cd1c74, server=jenkins-hbase4.apache.org,36483,1689761420784 in 192 msec 2023-07-19 10:10:50,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, ASSIGN in 358 msec 2023-07-19 10:10:50,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 10:10:50,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, ASSIGN in 359 msec 2023-07-19 10:10:50,599 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:10:50,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761450599"}]},"ts":"1689761450599"} 2023-07-19 10:10:50,601 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 10:10:50,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:10:50,605 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 10:10:50,607 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:10:50,609 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,609 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,609 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,609 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:10:50,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:10:50,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 852 msec 2023-07-19 10:10:50,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 10:10:50,874 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 10:10:50,877 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 10:10:50,878 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:50,880 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:50,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:50,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761450896 (current time:1689761450896). 2023-07-19 10:10:50,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:50,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x73bed70f to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:50,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ea0eb62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:50,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:50,909 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:50,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73bed70f to 127.0.0.1:54485 2023-07-19 10:10:50,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:50,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x2e948c3e to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:50,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b97304c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:50,943 DEBUG [hconnection-0x62a525a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:50,944 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:50,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:50,951 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:50,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e948c3e to 127.0.0.1:54485 2023-07-19 10:10:50,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:50,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:10:50,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:50,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:50,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:50,958 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:50,959 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762050959 2023-07-19 10:10:50,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:50,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 10:10:50,962 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:50,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:50,963 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:50,963 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:50,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 10:10:50,966 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:50,968 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762050968 2023-07-19 10:10:50,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,991 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 10:10:50,992 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,993 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 10:10:50,993 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:10:50,994 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,994 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,995 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:50,995 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:50,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:50,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:50,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:50,995 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:50,995 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:50,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:50,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:50,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:50,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,996 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:50,996 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:50,997 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:50,998 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:50,998 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:50,998 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:50,998 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:50,999 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,001 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,001 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:50,999 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,002 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,004 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,004 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,008 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,008 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,008 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,008 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,008 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,009 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,009 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,009 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,009 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:51,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50eef604[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:51,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:51,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50eef604[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:51,014 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:10:51,014 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,016 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,016 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:10:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,017 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:51,017 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. started... 2023-07-19 10:10:51,017 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:51,017 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,017 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:51,018 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,018 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,018 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,022 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:51,023 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f035df7268d59f3f44cfb3c61cd1c74: 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. started... 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c505934e30de4ca11612da79b51acef: 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:51,023 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:10:51,050 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. completed. 2023-07-19 10:10:51,050 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:51,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:10:51,052 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,052 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,052 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,052 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,055 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. completed. 2023-07-19 10:10:51,055 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,056 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:10:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,059 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,059 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,059 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,059 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,063 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:51,064 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:10:51,070 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 10:10:51,071 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:51,071 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:51,071 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,071 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:51,072 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,072 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,073 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,072 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,073 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,073 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,073 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,074 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,075 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,077 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,077 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,078 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,082 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,082 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,081 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 10:10:51,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:10:51,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 10:10:51,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 10:10:51,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,165 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 10:10:51,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689761450959Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689761451102 (+143 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689761451102Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689761451102Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689761451108 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689761451120 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689761451164 (+44 ms) 2023-07-19 10:10:51,168 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 207 msec 2023-07-19 10:10:51,265 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:51,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:51,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:10:51,277 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 10:10:51,278 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:51,278 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:10:51,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:51,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761451291 (current time:1689761451291). 2023-07-19 10:10:51,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:10:51,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x29509adb to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:51,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d6edb9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:51,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,304 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29509adb to 127.0.0.1:54485 2023-07-19 10:10:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x2519a5e8 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:10:51,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73fbf57a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:10:51,318 DEBUG [hconnection-0x617d386f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,322 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:10:51,332 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:10:51,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2519a5e8 to 127.0.0.1:54485 2023-07-19 10:10:51,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:10:51,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:10:51,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:10:51,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:51,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:51,339 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:51,341 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762051341 2023-07-19 10:10:51,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 10:10:51,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:10:51,342 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:10:51,342 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:10:51,344 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:10:51,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 10:10:51,347 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:51,348 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762051348 2023-07-19 10:10:51,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 10:10:51,386 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 10:10:51,386 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,387 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 10:10:51,388 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:10:51,388 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,388 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,389 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,389 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,390 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,389 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,390 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,390 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,391 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,391 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:10:51,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 10:10:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 10:10:51,392 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,392 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,392 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,403 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,403 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,403 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 10:10:51,412 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,412 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,414 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,414 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,414 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,413 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:10:51,414 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 10:10:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 10:10:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 10:10:51,419 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,419 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,419 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,420 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,419 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,420 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,420 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,420 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,420 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,421 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,421 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:10:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:51,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b655cbe[Count = 1] remaining members to acquire global barrier 2023-07-19 10:10:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 10:10:51,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b655cbe[Count = 0] remaining members to acquire global barrier 2023-07-19 10:10:51,427 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:10:51,427 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,433 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,433 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,434 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,434 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:10:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:10:51,434 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,434 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:10:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:51,440 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:10:51,440 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. started... 2023-07-19 10:10:51,440 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:51,441 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c505934e30de4ca11612da79b51acef 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 10:10:51,441 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. started... 2023-07-19 10:10:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:10:51,441 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f035df7268d59f3f44cfb3c61cd1c74 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 10:10:51,442 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:51,445 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:10:51,501 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719c59c977c837b4cfb99419e6e0382fb68 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c59c977c837b4cfb99419e6e0382fb68 2023-07-19 10:10:51,507 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307198b4b3dd7fdf84c9bbae363ccb2ef0045 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307198b4b3dd7fdf84c9bbae363ccb2ef0045 2023-07-19 10:10:51,542 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/.tmp/cf/88c8c41b6a704e7292061b441ff4a775 2023-07-19 10:10:51,551 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/.tmp/cf/88c8c41b6a704e7292061b441ff4a775 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf/88c8c41b6a704e7292061b441ff4a775 2023-07-19 10:10:51,568 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf/88c8c41b6a704e7292061b441ff4a775, entries=5, sequenceid=6, filesize=5.7 K 2023-07-19 10:10:51,569 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6c505934e30de4ca11612da79b51acef in 128ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:51,569 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 10:10:51,570 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c505934e30de4ca11612da79b51acef: 2023-07-19 10:10:51,570 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,571 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:51,571 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf/88c8c41b6a704e7292061b441ff4a775] hfiles 2023-07-19 10:10:51,571 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf/88c8c41b6a704e7292061b441ff4a775 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,613 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. completed. 2023-07-19 10:10:51,614 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:10:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,614 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:10:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,619 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,619 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:10:51,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:10:51,645 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:51,647 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:10:51,936 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/.tmp/cf/e26284b9fae34090957c07673490c671 2023-07-19 10:10:51,943 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/.tmp/cf/e26284b9fae34090957c07673490c671 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf/e26284b9fae34090957c07673490c671 2023-07-19 10:10:51,947 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:51,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:51,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:10:51,948 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 10:10:51,949 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf/e26284b9fae34090957c07673490c671, entries=45, sequenceid=6, filesize=12.5 K 2023-07-19 10:10:51,950 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 5f035df7268d59f3f44cfb3c61cd1c74 in 509ms, sequenceid=6, compaction requested=false 2023-07-19 10:10:51,952 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f035df7268d59f3f44cfb3c61cd1c74: 2023-07-19 10:10:51,952 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,952 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:10:51,952 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf/e26284b9fae34090957c07673490c671] hfiles 2023-07-19 10:10:51,952 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf/e26284b9fae34090957c07673490c671 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,960 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. completed. 2023-07-19 10:10:51,961 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:10:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:10:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:10:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 10:10:51,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:10:51,962 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 10:10:51,962 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,963 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 10:10:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:10:51,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:10:51,968 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 10:10:51,968 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:10:51,968 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:10:51,968 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 10:10:51,968 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:10:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,972 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:10:51,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,971 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,972 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,973 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:10:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,975 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:10:51,975 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 10:10:51,975 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,979 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:10:51,978 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,979 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 10:10:51,979 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:10:51,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 10:10:51,979 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:10:51,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 10:10:51,979 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:10:51,979 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,979 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:10:51,980 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:10:51,981 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:10:51,981 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,981 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 10:10:51,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:10:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:10:51,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c59c977c837b4cfb99419e6e0382fb68, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307198b4b3dd7fdf84c9bbae363ccb2ef0045] mob files 2023-07-19 10:10:51,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c59c977c837b4cfb99419e6e0382fb68 2023-07-19 10:10:51,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307198b4b3dd7fdf84c9bbae363ccb2ef0045 2023-07-19 10:10:51,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 10:10:51,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:52,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 10:10:52,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 10:10:52,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:52,054 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:52,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689761451341Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689761451992 (+651 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689761451992Loading Region manifests for snaptb0-testExportFileSystemState at 1689761451992Writing data manifest for snaptb0-testExportFileSystemState at 1689761451999 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689761452010 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689761452053 (+43 ms) 2023-07-19 10:10:52,056 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 10:10:52,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 715 msec 2023-07-19 10:10:52,448 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:10:52,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:10:52,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:10:52,450 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450 2023-07-19 10:10:52,450 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36553, tgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450, rawTgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:52,483 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:10:52,483 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-808341232_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:52,483 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 10:10:52,504 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 10:10:52,531 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,531 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,531 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:52,532 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,574 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-854050219301834426.jar 2023-07-19 10:10:53,574 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,575 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,642 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-2371186152885043106.jar 2023-07-19 10:10:53,642 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,643 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,643 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,644 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,644 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,644 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:10:53,645 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:10:53,645 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:10:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:10:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:10:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:10:53,647 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:10:53,647 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:10:53,648 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:10:53,648 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:10:53,649 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:10:53,649 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:53,650 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:53,650 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:53,650 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:53,651 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:10:53,651 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:53,652 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:10:53,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0001_000001 (auth:SIMPLE) 2023-07-19 10:10:54,101 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:10:54,103 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 10:10:54,105 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 10:10:54,187 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:54,187 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:10:54,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0002_000001 (auth:SIMPLE) 2023-07-19 10:10:54,991 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:10:59,800 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:02,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:05,829 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:07,316 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:11:07,319 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:11:07,329 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 10:11:07,329 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:11:07,330 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:11:07,330 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 10:11:07,331 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 10:11:07,331 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 10:11:07,331 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 10:11:07,331 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 10:11:07,331 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761452450/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 10:11:07,339 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 10:11:07,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 10:11:07,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 10:11:07,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761467347"}]},"ts":"1689761467347"} 2023-07-19 10:11:07,349 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 10:11:07,351 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 10:11:07,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, UNASSIGN}] 2023-07-19 10:11:07,354 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, UNASSIGN 2023-07-19 10:11:07,354 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, UNASSIGN 2023-07-19 10:11:07,355 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6c505934e30de4ca11612da79b51acef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:07,355 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5f035df7268d59f3f44cfb3c61cd1c74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:07,355 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761467355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761467355"}]},"ts":"1689761467355"} 2023-07-19 10:11:07,355 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761467355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761467355"}]},"ts":"1689761467355"} 2023-07-19 10:11:07,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 5f035df7268d59f3f44cfb3c61cd1c74, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:11:07,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 6c505934e30de4ca11612da79b51acef, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:11:07,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 10:11:07,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6c505934e30de4ca11612da79b51acef 2023-07-19 10:11:07,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c505934e30de4ca11612da79b51acef, disabling compactions & flushes 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f035df7268d59f3f44cfb3c61cd1c74, disabling compactions & flushes 2023-07-19 10:11:07,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:11:07,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. after waiting 0 ms 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. after waiting 0 ms 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:11:07,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:11:07,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:07,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:07,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:07,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74. 2023-07-19 10:11:07,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f035df7268d59f3f44cfb3c61cd1c74: 2023-07-19 10:11:07,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:07,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef. 2023-07-19 10:11:07,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c505934e30de4ca11612da79b51acef: 2023-07-19 10:11:07,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:11:07,539 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5f035df7268d59f3f44cfb3c61cd1c74, regionState=CLOSED 2023-07-19 10:11:07,539 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761467539"}]},"ts":"1689761467539"} 2023-07-19 10:11:07,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6c505934e30de4ca11612da79b51acef 2023-07-19 10:11:07,540 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6c505934e30de4ca11612da79b51acef, regionState=CLOSED 2023-07-19 10:11:07,540 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689761467540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761467540"}]},"ts":"1689761467540"} 2023-07-19 10:11:07,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-19 10:11:07,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 5f035df7268d59f3f44cfb3c61cd1c74, server=jenkins-hbase4.apache.org,36483,1689761420784 in 184 msec 2023-07-19 10:11:07,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-19 10:11:07,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 6c505934e30de4ca11612da79b51acef, server=jenkins-hbase4.apache.org,41773,1689761420713 in 184 msec 2023-07-19 10:11:07,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f035df7268d59f3f44cfb3c61cd1c74, UNASSIGN in 192 msec 2023-07-19 10:11:07,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-19 10:11:07,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6c505934e30de4ca11612da79b51acef, UNASSIGN in 193 msec 2023-07-19 10:11:07,548 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761467548"}]},"ts":"1689761467548"} 2023-07-19 10:11:07,549 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 10:11:07,551 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 10:11:07,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-19 10:11:07,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 10:11:07,650 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 10:11:07,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 10:11:07,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,656 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 10:11:07,657 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,658 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 10:11:07,663 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef 2023-07-19 10:11:07,663 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:11:07,665 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/recovered.edits] 2023-07-19 10:11:07,666 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/recovered.edits] 2023-07-19 10:11:07,666 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,666 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,666 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,667 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,667 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,667 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 10:11:07,670 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,671 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf/e26284b9fae34090957c07673490c671 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/cf/e26284b9fae34090957c07673490c671 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-19 10:11:07,673 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:11:07,673 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf/88c8c41b6a704e7292061b441ff4a775 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/cf/88c8c41b6a704e7292061b441ff4a775 2023-07-19 10:11:07,672 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:07,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 10:11:07,677 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74/recovered.edits/9.seqid 2023-07-19 10:11:07,678 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/5f035df7268d59f3f44cfb3c61cd1c74 2023-07-19 10:11:07,678 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef/recovered.edits/9.seqid 2023-07-19 10:11:07,679 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemState/6c505934e30de4ca11612da79b51acef 2023-07-19 10:11:07,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 10:11:07,680 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 10:11:07,680 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-19 10:11:07,685 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c59c977c837b4cfb99419e6e0382fb68 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c59c977c837b4cfb99419e6e0382fb68 2023-07-19 10:11:07,687 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307198b4b3dd7fdf84c9bbae363ccb2ef0045 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307198b4b3dd7fdf84c9bbae363ccb2ef0045 2023-07-19 10:11:07,688 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 10:11:07,691 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,694 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 10:11:07,700 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 10:11:07,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 10:11:07,701 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761467701"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:07,701 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761467701"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:07,703 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:11:07,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6c505934e30de4ca11612da79b51acef, NAME => 'testtb-testExportFileSystemState,,1689761449758.6c505934e30de4ca11612da79b51acef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5f035df7268d59f3f44cfb3c61cd1c74, NAME => 'testtb-testExportFileSystemState,1,1689761449758.5f035df7268d59f3f44cfb3c61cd1c74.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:11:07,703 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 10:11:07,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761467703"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:07,705 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 10:11:07,707 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 10:11:07,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 56 msec 2023-07-19 10:11:07,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 10:11:07,775 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 10:11:07,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 10:11:07,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 10:11:07,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 10:11:07,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 10:11:07,819 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 752) Potentially hanging thread: Thread-2013 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:37823 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:36764 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:52468 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-62474090_1 at /127.0.0.1:52448 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:45748 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:43315 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-62474090_1 at /127.0.0.1:36730 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=533 (was 434) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2848 (was 3100) 2023-07-19 10:11:07,819 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 10:11:07,843 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=533, ProcessCount=182, AvailableMemoryMB=2848 2023-07-19 10:11:07,843 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 10:11:07,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 10:11:07,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:07,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:11:07,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 10:11:07,850 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:11:07,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:07,854 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:07,854 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:07,854 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 empty. 2023-07-19 10:11:07,855 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 empty. 2023-07-19 10:11:07,855 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:07,855 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:07,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 10:11:07,866 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 10:11:07,868 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8842ececb4aac13ecaed16dca71efe00, NAME => 'testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:11:07,868 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 75b6a4d1c0516de134010854ed43bdc0, NAME => 'testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:11:07,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:07,887 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 75b6a4d1c0516de134010854ed43bdc0, disabling compactions & flushes 2023-07-19 10:11:07,887 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:07,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:07,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. after waiting 0 ms 2023-07-19 10:11:07,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:07,888 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:07,888 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 75b6a4d1c0516de134010854ed43bdc0: 2023-07-19 10:11:07,889 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:07,889 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8842ececb4aac13ecaed16dca71efe00, disabling compactions & flushes 2023-07-19 10:11:07,889 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:07,889 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:07,889 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. after waiting 0 ms 2023-07-19 10:11:07,889 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:07,889 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:07,889 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8842ececb4aac13ecaed16dca71efe00: 2023-07-19 10:11:07,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:11:07,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761467893"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761467893"}]},"ts":"1689761467893"} 2023-07-19 10:11:07,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761467893"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761467893"}]},"ts":"1689761467893"} 2023-07-19 10:11:07,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:11:07,896 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:11:07,896 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761467896"}]},"ts":"1689761467896"} 2023-07-19 10:11:07,898 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 10:11:07,902 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:11:07,903 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:11:07,903 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:11:07,903 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:11:07,903 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:11:07,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, ASSIGN}] 2023-07-19 10:11:07,907 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, ASSIGN 2023-07-19 10:11:07,907 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, ASSIGN 2023-07-19 10:11:07,908 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1689761420784; forceNewPlan=false, retain=false 2023-07-19 10:11:07,908 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1689761420847; forceNewPlan=false, retain=false 2023-07-19 10:11:07,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:08,059 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:11:08,061 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=75b6a4d1c0516de134010854ed43bdc0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,061 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8842ececb4aac13ecaed16dca71efe00, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,062 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468061"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761468061"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761468061"}]},"ts":"1689761468061"} 2023-07-19 10:11:08,062 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468061"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761468061"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761468061"}]},"ts":"1689761468061"} 2023-07-19 10:11:08,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 8842ececb4aac13ecaed16dca71efe00, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:11:08,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 75b6a4d1c0516de134010854ed43bdc0, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:11:08,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:08,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:08,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8842ececb4aac13ecaed16dca71efe00, NAME => 'testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:11:08,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. service=AccessControlService 2023-07-19 10:11:08,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:08,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:08,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:08,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75b6a4d1c0516de134010854ed43bdc0, NAME => 'testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:11:08,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. service=AccessControlService 2023-07-19 10:11:08,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,223 INFO [StoreOpener-8842ececb4aac13ecaed16dca71efe00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,224 INFO [StoreOpener-75b6a4d1c0516de134010854ed43bdc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,224 DEBUG [StoreOpener-8842ececb4aac13ecaed16dca71efe00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf 2023-07-19 10:11:08,224 DEBUG [StoreOpener-8842ececb4aac13ecaed16dca71efe00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf 2023-07-19 10:11:08,225 INFO [StoreOpener-8842ececb4aac13ecaed16dca71efe00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8842ececb4aac13ecaed16dca71efe00 columnFamilyName cf 2023-07-19 10:11:08,225 DEBUG [StoreOpener-75b6a4d1c0516de134010854ed43bdc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf 2023-07-19 10:11:08,225 DEBUG [StoreOpener-75b6a4d1c0516de134010854ed43bdc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf 2023-07-19 10:11:08,226 INFO [StoreOpener-75b6a4d1c0516de134010854ed43bdc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75b6a4d1c0516de134010854ed43bdc0 columnFamilyName cf 2023-07-19 10:11:08,226 INFO [StoreOpener-8842ececb4aac13ecaed16dca71efe00-1] regionserver.HStore(310): Store=8842ececb4aac13ecaed16dca71efe00/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:08,227 INFO [StoreOpener-75b6a4d1c0516de134010854ed43bdc0-1] regionserver.HStore(310): Store=75b6a4d1c0516de134010854ed43bdc0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:08,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:08,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:08,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:08,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8842ececb4aac13ecaed16dca71efe00; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64625305, jitterRate=-0.03700791299343109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:08,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:08,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8842ececb4aac13ecaed16dca71efe00: 2023-07-19 10:11:08,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 75b6a4d1c0516de134010854ed43bdc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69661595, jitterRate=0.03803865611553192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:08,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 75b6a4d1c0516de134010854ed43bdc0: 2023-07-19 10:11:08,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00., pid=45, masterSystemTime=1689761468215 2023-07-19 10:11:08,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0., pid=46, masterSystemTime=1689761468216 2023-07-19 10:11:08,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:08,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:08,241 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8842ececb4aac13ecaed16dca71efe00, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,242 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468241"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761468241"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761468241"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761468241"}]},"ts":"1689761468241"} 2023-07-19 10:11:08,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:08,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:08,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=75b6a4d1c0516de134010854ed43bdc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761468243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761468243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761468243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761468243"}]},"ts":"1689761468243"} 2023-07-19 10:11:08,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-19 10:11:08,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 8842ececb4aac13ecaed16dca71efe00, server=jenkins-hbase4.apache.org,36483,1689761420784 in 180 msec 2023-07-19 10:11:08,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-19 10:11:08,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 75b6a4d1c0516de134010854ed43bdc0, server=jenkins-hbase4.apache.org,43767,1689761420847 in 181 msec 2023-07-19 10:11:08,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, ASSIGN in 344 msec 2023-07-19 10:11:08,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-19 10:11:08,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, ASSIGN in 344 msec 2023-07-19 10:11:08,250 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:11:08,250 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761468250"}]},"ts":"1689761468250"} 2023-07-19 10:11:08,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 10:11:08,254 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:11:08,254 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 10:11:08,256 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 10:11:08,258 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,258 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,258 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,258 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:08,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:08,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 414 msec 2023-07-19 10:11:08,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 10:11:08,454 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 10:11:08,457 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 10:11:08,457 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:08,460 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:08,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761468473 (current time:1689761468473). 2023-07-19 10:11:08,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:08,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x08553377 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:08,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@482857e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:08,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,485 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08553377 to 127.0.0.1:54485 2023-07-19 10:11:08,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:08,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x052ff156 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:08,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24c0b40f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:08,493 DEBUG [hconnection-0x2e5d3068-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,496 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:08,503 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:08,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x052ff156 to 127.0.0.1:54485 2023-07-19 10:11:08,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:08,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 10:11:08,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:08,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:08,510 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:08,511 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689762068511 2023-07-19 10:11:08,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:08,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 10:11:08,512 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:08,512 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:08,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:08,513 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:08,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 10:11:08,516 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:08,519 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689762068519 2023-07-19 10:11:08,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,533 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 10:11:08,533 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,534 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 10:11:08,534 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 10:11:08,535 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,535 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,540 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,540 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,540 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,540 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,540 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,540 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,541 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,541 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:08,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:08,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:08,545 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:08,550 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,550 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,550 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,550 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,551 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3f0411[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:08,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3f0411[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:08,556 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 10:11:08,556 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:08,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:08,558 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:08,558 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:08,558 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,559 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:11:08,558 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:08,558 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:08,559 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. started... 2023-07-19 10:11:08,559 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. started... 2023-07-19 10:11:08,560 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75b6a4d1c0516de134010854ed43bdc0: 2023-07-19 10:11:08,560 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8842ececb4aac13ecaed16dca71efe00: 2023-07-19 10:11:08,560 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,561 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:08,561 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,561 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:08,562 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:08,562 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,567 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:08,579 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. completed. 2023-07-19 10:11:08,579 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:11:08,583 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:08,583 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,583 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,584 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:08,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,586 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. completed. 2023-07-19 10:11:08,586 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:08,586 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:08,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:11:08,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:08,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,590 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:11:08,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 10:11:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43767,1689761420847': 2023-07-19 10:11:08,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 10:11:08,598 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 10:11:08,598 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:08,598 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:08,598 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,598 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:08,602 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,603 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:08,603 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,606 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:08,606 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,607 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,610 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:08,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:08,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:08,611 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:08,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:11:08,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:08,612 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:08,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 10:11:08,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:08,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:08,614 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:08,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:08,814 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:08,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:08,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:08,816 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:09,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 10:11:09,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:09,099 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:09,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689761468511Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689761468625 (+114 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689761468625Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689761468625Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689761468629 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689761468660 (+31 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689761469098 (+438 ms) 2023-07-19 10:11:09,102 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 590 msec 2023-07-19 10:11:09,116 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:09,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:09,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:09,127 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 10:11:09,127 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:09,128 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:09,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:09,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761469140 (current time:1689761469140). 2023-07-19 10:11:09,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:09,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x43b4110f to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ee1b8f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:09,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:09,163 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:09,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43b4110f to 127.0.0.1:54485 2023-07-19 10:11:09,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:09,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x24ee768f to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:09,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47b12774, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:09,175 DEBUG [hconnection-0x64b4314a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:09,176 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:09,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:09,180 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:09,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24ee768f to 127.0.0.1:54485 2023-07-19 10:11:09,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:09,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 10:11:09,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:09,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:09,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:09,185 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:09,186 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689762069186 2023-07-19 10:11:09,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 10:11:09,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 10:11:09,187 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:09,187 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:09,191 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 10:11:09,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-19 10:11:09,193 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,194 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689762069194 2023-07-19 10:11:09,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 10:11:09,207 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 10:11:09,207 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,209 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 10:11:09,209 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 10:11:09,209 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,209 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,231 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,231 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,231 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,231 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,231 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,231 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,232 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,232 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 10:11:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,233 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:09,233 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:09,233 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,235 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:09,233 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,235 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:09,236 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:09,236 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:09,236 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:09,235 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 10:11:09,236 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:09,236 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:09,237 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 10:11:09,237 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 10:11:09,237 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 10:11:09,271 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,271 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,288 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:09,289 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:09,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,300 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,300 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:09,300 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,339 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,339 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,339 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,339 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:09,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,339 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,339 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:09,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b40db4e[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 10:11:09,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b40db4e[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:09,342 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 10:11:09,343 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:09,377 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:11:09,378 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,378 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:09,378 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:09,378 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:09,378 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. started... 2023-07-19 10:11:09,378 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:09,378 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. started... 2023-07-19 10:11:09,378 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 75b6a4d1c0516de134010854ed43bdc0 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 10:11:09,378 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8842ececb4aac13ecaed16dca71efe00 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 10:11:09,384 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:09,384 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,385 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:09,404 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071954fe9dc18ec447f485ee143d95d58fe5 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071954fe9dc18ec447f485ee143d95d58fe5 2023-07-19 10:11:09,406 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071969f465945d35496ebc7b57d96296dbe8 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071969f465945d35496ebc7b57d96296dbe8 2023-07-19 10:11:09,419 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/.tmp/cf/7a2f2757d3ea42e697376309e3b3e7d8 2023-07-19 10:11:09,425 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/.tmp/cf/7a2f2757d3ea42e697376309e3b3e7d8 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf/7a2f2757d3ea42e697376309e3b3e7d8 2023-07-19 10:11:09,425 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/.tmp/cf/2e2d99c695894b25921f24c45534a874 2023-07-19 10:11:09,431 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/.tmp/cf/2e2d99c695894b25921f24c45534a874 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf/2e2d99c695894b25921f24c45534a874 2023-07-19 10:11:09,434 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf/7a2f2757d3ea42e697376309e3b3e7d8, entries=45, sequenceid=6, filesize=12.4 K 2023-07-19 10:11:09,435 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8842ececb4aac13ecaed16dca71efe00 in 57ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:09,435 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 10:11:09,435 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8842ececb4aac13ecaed16dca71efe00: 2023-07-19 10:11:09,435 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,435 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:09,435 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf/7a2f2757d3ea42e697376309e3b3e7d8] hfiles 2023-07-19 10:11:09,436 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf/7a2f2757d3ea42e697376309e3b3e7d8 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,437 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf/2e2d99c695894b25921f24c45534a874, entries=5, sequenceid=6, filesize=5.7 K 2023-07-19 10:11:09,437 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 75b6a4d1c0516de134010854ed43bdc0 in 59ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:09,439 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 75b6a4d1c0516de134010854ed43bdc0: 2023-07-19 10:11:09,440 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,440 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:09,440 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf/2e2d99c695894b25921f24c45534a874] hfiles 2023-07-19 10:11:09,440 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf/2e2d99c695894b25921f24c45534a874 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,452 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. completed. 2023-07-19 10:11:09,452 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:09,452 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:09,452 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:09,452 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,452 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:09,452 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:11:09,454 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,454 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,454 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,454 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,456 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. completed. 2023-07-19 10:11:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,456 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:09,456 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:09,456 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:09,456 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,456 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 10:11:09,456 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:11:09,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,459 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,459 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 10:11:09,459 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,459 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 10:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43767,1689761420847': 2023-07-19 10:11:09,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 10:11:09,466 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 10:11:09,467 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:09,467 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:09,467 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 10:11:09,467 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:09,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:09,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,469 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,469 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,470 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:09,470 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 10:11:09,476 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,477 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,477 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,485 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:09,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 10:11:09,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:09,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 10:11:09,484 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:09,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 10:11:09,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:11:09,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,486 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:09,487 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:09,487 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,487 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:09,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071954fe9dc18ec447f485ee143d95d58fe5, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071969f465945d35496ebc7b57d96296dbe8] mob files 2023-07-19 10:11:09,488 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:09,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071954fe9dc18ec447f485ee143d95d58fe5 2023-07-19 10:11:09,488 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071969f465945d35496ebc7b57d96296dbe8 2023-07-19 10:11:09,488 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,489 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:09,491 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:09,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 10:11:09,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,584 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 10:11:09,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,584 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689761469186Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689761469501 (+315 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689761469501Loading Region manifests for snaptb0-testConsecutiveExports at 1689761469501Writing data manifest for snaptb0-testConsecutiveExports at 1689761469507 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689761469543 (+36 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689761469584 (+41 ms) 2023-07-19 10:11:09,588 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 10:11:09,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 401 msec 2023-07-19 10:11:09,791 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:09,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 10:11:09,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:09,792 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792 2023-07-19 10:11:09,792 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:11:09,822 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:11:09,823 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5f3d233e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,823 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 10:11:09,832 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:09,844 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:09,844 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:09,845 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:09,845 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,776 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-4804449797491981552.jar 2023-07-19 10:11:10,776 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,777 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,859 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-765726954942314424.jar 2023-07-19 10:11:10,860 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,860 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,861 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,861 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,861 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,862 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:10,862 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:11:10,863 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:11:10,863 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:11:10,864 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:11:10,864 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:11:10,865 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:11:10,865 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:11:10,866 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:11:10,866 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:11:10,867 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:11:10,868 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,868 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,869 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:10,869 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,869 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:10,870 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:10,871 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:11,402 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:11:11,405 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 10:11:11,407 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 10:11:12,013 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:12,013 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:12,016 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0002_000001 (auth:SIMPLE) 2023-07-19 10:11:12,768 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:13,119 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:11:17,241 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:19,485 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:22,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:23,588 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:11:23,589 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:11:23,593 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 10:11:23,593 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:11:23,594 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:11:23,595 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:23,595 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:23,595 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:23,595 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@26d9a726 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:23,596 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:23,596 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:23,597 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:11:23,621 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:11:23,621 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@25738067, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:23,621 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 10:11:23,631 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 10:11:23,642 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:23,642 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:23,643 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:23,643 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,554 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-1224346947414257323.jar 2023-07-19 10:11:24,555 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,556 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,624 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-5467700635119666863.jar 2023-07-19 10:11:24,625 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,625 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,626 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,626 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,627 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,627 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:24,628 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:11:24,629 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:11:24,629 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:11:24,630 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:11:24,630 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:11:24,631 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:11:24,631 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:11:24,631 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:11:24,631 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:11:24,632 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:11:24,633 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:24,633 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:24,634 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:24,634 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:24,635 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:24,635 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:24,636 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:25,117 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:11:25,120 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 10:11:25,122 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 10:11:28,440 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:28,441 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:28,444 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0003_000001 (auth:SIMPLE) 2023-07-19 10:11:29,028 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:33,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:35,793 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:39,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:41,335 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:11:41,336 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:11:41,340 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 10:11:41,340 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:11:41,340 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:11:41,341 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@26d9a726 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 10:11:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 10:11:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/local-export-1689761469792/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 10:11:41,372 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 10:11:41,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 10:11:41,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 10:11:41,384 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761501384"}]},"ts":"1689761501384"} 2023-07-19 10:11:41,387 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 10:11:41,389 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 10:11:41,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, UNASSIGN}] 2023-07-19 10:11:41,394 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, UNASSIGN 2023-07-19 10:11:41,396 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, UNASSIGN 2023-07-19 10:11:41,397 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8842ececb4aac13ecaed16dca71efe00, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:41,397 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761501397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761501397"}]},"ts":"1689761501397"} 2023-07-19 10:11:41,398 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=75b6a4d1c0516de134010854ed43bdc0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:41,398 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501398"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761501398"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761501398"}]},"ts":"1689761501398"} 2023-07-19 10:11:41,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 8842ececb4aac13ecaed16dca71efe00, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:11:41,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 75b6a4d1c0516de134010854ed43bdc0, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:11:41,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 10:11:41,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8842ececb4aac13ecaed16dca71efe00, disabling compactions & flushes 2023-07-19 10:11:41,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. after waiting 0 ms 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:41,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 75b6a4d1c0516de134010854ed43bdc0, disabling compactions & flushes 2023-07-19 10:11:41,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. after waiting 0 ms 2023-07-19 10:11:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:41,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:41,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:11:41,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:41,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:41,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00. 2023-07-19 10:11:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8842ececb4aac13ecaed16dca71efe00: 2023-07-19 10:11:41,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0. 2023-07-19 10:11:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 75b6a4d1c0516de134010854ed43bdc0: 2023-07-19 10:11:41,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:41,571 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8842ececb4aac13ecaed16dca71efe00, regionState=CLOSED 2023-07-19 10:11:41,571 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501571"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501571"}]},"ts":"1689761501571"} 2023-07-19 10:11:41,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:41,572 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=75b6a4d1c0516de134010854ed43bdc0, regionState=CLOSED 2023-07-19 10:11:41,572 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689761501572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501572"}]},"ts":"1689761501572"} 2023-07-19 10:11:41,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 10:11:41,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 8842ececb4aac13ecaed16dca71efe00, server=jenkins-hbase4.apache.org,36483,1689761420784 in 172 msec 2023-07-19 10:11:41,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 10:11:41,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 75b6a4d1c0516de134010854ed43bdc0, server=jenkins-hbase4.apache.org,43767,1689761420847 in 173 msec 2023-07-19 10:11:41,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8842ececb4aac13ecaed16dca71efe00, UNASSIGN in 183 msec 2023-07-19 10:11:41,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-19 10:11:41,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=75b6a4d1c0516de134010854ed43bdc0, UNASSIGN in 183 msec 2023-07-19 10:11:41,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761501579"}]},"ts":"1689761501579"} 2023-07-19 10:11:41,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 10:11:41,584 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 10:11:41,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 214 msec 2023-07-19 10:11:41,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 10:11:41,685 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 10:11:41,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 10:11:41,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,691 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 10:11:41,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,695 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 10:11:41,699 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,699 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,699 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 10:11:41,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 10:11:41,701 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:41,699 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,701 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,702 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,702 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 10:11:41,702 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,702 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,702 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:41,701 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:41,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-19 10:11:41,704 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:11:41,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-19 10:11:41,704 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:11:41,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 10:11:41,706 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/recovered.edits] 2023-07-19 10:11:41,707 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/recovered.edits] 2023-07-19 10:11:41,712 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf/7a2f2757d3ea42e697376309e3b3e7d8 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/cf/7a2f2757d3ea42e697376309e3b3e7d8 2023-07-19 10:11:41,714 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf/2e2d99c695894b25921f24c45534a874 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/cf/2e2d99c695894b25921f24c45534a874 2023-07-19 10:11:41,720 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00/recovered.edits/9.seqid 2023-07-19 10:11:41,721 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/8842ececb4aac13ecaed16dca71efe00 2023-07-19 10:11:41,722 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0/recovered.edits/9.seqid 2023-07-19 10:11:41,722 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testConsecutiveExports/75b6a4d1c0516de134010854ed43bdc0 2023-07-19 10:11:41,722 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 10:11:41,727 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 10:11:41,728 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-19 10:11:41,736 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071954fe9dc18ec447f485ee143d95d58fe5 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071954fe9dc18ec447f485ee143d95d58fe5 2023-07-19 10:11:41,737 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071969f465945d35496ebc7b57d96296dbe8 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071969f465945d35496ebc7b57d96296dbe8 2023-07-19 10:11:41,738 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 10:11:41,740 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,743 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 10:11:41,751 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 10:11:41,752 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,752 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 10:11:41,752 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761501752"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:41,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761501752"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:41,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:11:41,755 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75b6a4d1c0516de134010854ed43bdc0, NAME => 'testtb-testConsecutiveExports,,1689761467844.75b6a4d1c0516de134010854ed43bdc0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8842ececb4aac13ecaed16dca71efe00, NAME => 'testtb-testConsecutiveExports,1,1689761467844.8842ececb4aac13ecaed16dca71efe00.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:11:41,755 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 10:11:41,755 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761501755"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:41,761 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 10:11:41,764 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 10:11:41,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 77 msec 2023-07-19 10:11:41,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 10:11:41,807 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 10:11:41,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 10:11:41,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 10:11:41,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 10:11:41,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 10:11:41,860 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 763), OpenFileDescriptor=894 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=497 (was 533), ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=3017 (was 2848) - AvailableMemoryMB LEAK? - 2023-07-19 10:11:41,860 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-19 10:11:41,883 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=497, ProcessCount=184, AvailableMemoryMB=3015 2023-07-19 10:11:41,883 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-19 10:11:41,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 10:11:41,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:41,888 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:11:41,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 10:11:41,889 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:11:41,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:41,892 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:41,896 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 empty. 2023-07-19 10:11:41,896 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:41,897 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:41,897 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 empty. 2023-07-19 10:11:41,898 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:41,898 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 10:11:41,916 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 10:11:41,919 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8339fb9a13073d13587ab9e7ce027680, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:11:41,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa849a5f7f8c806cc4cbf918fa20a4c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:11:41,955 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:41,955 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing fa849a5f7f8c806cc4cbf918fa20a4c1, disabling compactions & flushes 2023-07-19 10:11:41,955 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:41,955 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:41,955 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. after waiting 0 ms 2023-07-19 10:11:41,955 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:41,955 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:41,955 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for fa849a5f7f8c806cc4cbf918fa20a4c1: 2023-07-19 10:11:41,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:41,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 8339fb9a13073d13587ab9e7ce027680, disabling compactions & flushes 2023-07-19 10:11:41,967 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:41,967 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:41,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. after waiting 0 ms 2023-07-19 10:11:41,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:41,968 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:41,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 8339fb9a13073d13587ab9e7ce027680: 2023-07-19 10:11:41,972 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:11:41,973 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761501972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501972"}]},"ts":"1689761501972"} 2023-07-19 10:11:41,973 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761501972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761501972"}]},"ts":"1689761501972"} 2023-07-19 10:11:41,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:41,997 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:11:41,999 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:11:41,999 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761501999"}]},"ts":"1689761501999"} 2023-07-19 10:11:42,001 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 10:11:42,005 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:11:42,008 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:11:42,008 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:11:42,008 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:11:42,008 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:11:42,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, ASSIGN}] 2023-07-19 10:11:42,012 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, ASSIGN 2023-07-19 10:11:42,012 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, ASSIGN 2023-07-19 10:11:42,013 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:11:42,013 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1689761420847; forceNewPlan=false, retain=false 2023-07-19 10:11:42,164 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:11:42,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8339fb9a13073d13587ab9e7ce027680, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,168 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761502167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761502167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761502167"}]},"ts":"1689761502167"} 2023-07-19 10:11:42,168 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=fa849a5f7f8c806cc4cbf918fa20a4c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,168 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761502168"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761502168"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761502168"}]},"ts":"1689761502168"} 2023-07-19 10:11:42,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 8339fb9a13073d13587ab9e7ce027680, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:11:42,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure fa849a5f7f8c806cc4cbf918fa20a4c1, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:11:42,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:42,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:42,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8339fb9a13073d13587ab9e7ce027680, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:11:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. service=AccessControlService 2023-07-19 10:11:42,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,351 INFO [StoreOpener-8339fb9a13073d13587ab9e7ce027680-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:42,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa849a5f7f8c806cc4cbf918fa20a4c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:11:42,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. service=AccessControlService 2023-07-19 10:11:42,354 DEBUG [StoreOpener-8339fb9a13073d13587ab9e7ce027680-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf 2023-07-19 10:11:42,355 DEBUG [StoreOpener-8339fb9a13073d13587ab9e7ce027680-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf 2023-07-19 10:11:42,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:42,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:42,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,364 INFO [StoreOpener-8339fb9a13073d13587ab9e7ce027680-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8339fb9a13073d13587ab9e7ce027680 columnFamilyName cf 2023-07-19 10:11:42,367 INFO [StoreOpener-fa849a5f7f8c806cc4cbf918fa20a4c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,368 INFO [StoreOpener-8339fb9a13073d13587ab9e7ce027680-1] regionserver.HStore(310): Store=8339fb9a13073d13587ab9e7ce027680/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:42,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:11:42,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:42,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8339fb9a13073d13587ab9e7ce027680; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60815269, jitterRate=-0.09378187358379364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:42,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8339fb9a13073d13587ab9e7ce027680: 2023-07-19 10:11:42,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680., pid=60, masterSystemTime=1689761502323 2023-07-19 10:11:42,377 DEBUG [StoreOpener-fa849a5f7f8c806cc4cbf918fa20a4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf 2023-07-19 10:11:42,377 DEBUG [StoreOpener-fa849a5f7f8c806cc4cbf918fa20a4c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf 2023-07-19 10:11:42,377 INFO [StoreOpener-fa849a5f7f8c806cc4cbf918fa20a4c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa849a5f7f8c806cc4cbf918fa20a4c1 columnFamilyName cf 2023-07-19 10:11:42,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:42,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:42,379 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8339fb9a13073d13587ab9e7ce027680, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,380 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761502379"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761502379"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761502379"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761502379"}]},"ts":"1689761502379"} 2023-07-19 10:11:42,381 INFO [StoreOpener-fa849a5f7f8c806cc4cbf918fa20a4c1-1] regionserver.HStore(310): Store=fa849a5f7f8c806cc4cbf918fa20a4c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:42,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 10:11:42,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 8339fb9a13073d13587ab9e7ce027680, server=jenkins-hbase4.apache.org,43767,1689761420847 in 210 msec 2023-07-19 10:11:42,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, ASSIGN in 376 msec 2023-07-19 10:11:42,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:11:42,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:42,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fa849a5f7f8c806cc4cbf918fa20a4c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63896230, jitterRate=-0.04787197709083557}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:42,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fa849a5f7f8c806cc4cbf918fa20a4c1: 2023-07-19 10:11:42,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1., pid=61, masterSystemTime=1689761502331 2023-07-19 10:11:42,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:42,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:42,392 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=fa849a5f7f8c806cc4cbf918fa20a4c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761502392"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761502392"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761502392"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761502392"}]},"ts":"1689761502392"} 2023-07-19 10:11:42,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 10:11:42,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure fa849a5f7f8c806cc4cbf918fa20a4c1, server=jenkins-hbase4.apache.org,41773,1689761420713 in 221 msec 2023-07-19 10:11:42,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-19 10:11:42,399 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, ASSIGN in 388 msec 2023-07-19 10:11:42,399 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:11:42,400 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761502399"}]},"ts":"1689761502399"} 2023-07-19 10:11:42,401 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 10:11:42,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:11:42,403 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 10:11:42,405 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 10:11:42,408 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,408 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,408 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,408 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:42,409 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,409 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:42,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 524 msec 2023-07-19 10:11:42,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 10:11:42,494 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 10:11:42,501 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,501 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:42,506 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:42,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:42,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761502564 (current time:1689761502564). 2023-07-19 10:11:42,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:42,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x3f501ea2 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:42,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6699db59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:42,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:42,588 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:42,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f501ea2 to 127.0.0.1:54485 2023-07-19 10:11:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x66e7d401 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:42,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@597d6371, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:42,611 DEBUG [hconnection-0x71962814-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:42,616 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:42,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:42,628 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66e7d401 to 127.0.0.1:54485 2023-07-19 10:11:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:42,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 10:11:42,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:42,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:42,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:42,643 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:42,647 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689762102647 2023-07-19 10:11:42,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:42,649 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:42,650 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:42,652 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:42,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:42,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-19 10:11:42,655 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:42,661 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689762102661 2023-07-19 10:11:42,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,705 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 10:11:42,705 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,706 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 10:11:42,706 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 10:11:42,737 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,737 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,738 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,738 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,738 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,738 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,741 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,741 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,742 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 10:11:42,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,742 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:42,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:42,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,743 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:42,743 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 10:11:42,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:42,744 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:42,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 10:11:42,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,744 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:42,744 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:42,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,750 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:42,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:42,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:42,751 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,755 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:42,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb952f4[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:42,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,765 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,765 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,765 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:42,765 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,765 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:42,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb952f4[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:42,767 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 10:11:42,767 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:11:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:42,769 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,770 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:42,770 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:42,770 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:42,771 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:42,771 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. started... 2023-07-19 10:11:42,773 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:42,773 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa849a5f7f8c806cc4cbf918fa20a4c1: 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. started... 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8339fb9a13073d13587ab9e7ce027680: 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:42,773 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:11:42,779 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:42,779 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,779 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:42,815 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. completed. 2023-07-19 10:11:42,815 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:11:42,817 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,817 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,817 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,817 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:11:42,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 10:11:42,843 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. completed. 2023-07-19 10:11:42,843 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:42,844 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:42,844 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:42,844 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,844 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:42,844 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:11:42,852 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43767,1689761420847': 2023-07-19 10:11:42,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 10:11:42,860 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 10:11:42,860 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:42,860 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:42,860 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,860 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:42,863 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,863 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,863 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,863 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:42,863 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,864 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:42,864 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,865 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:42,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,863 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,865 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,869 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,869 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,870 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,873 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,873 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,874 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:42,874 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:11:42,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-19 10:11:42,873 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,876 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,874 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:42,877 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:42,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 10:11:42,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,876 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,878 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:42,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:42,957 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:42,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:42,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:42,959 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:43,259 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:43,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:43,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:43,263 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 10:11:43,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,763 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:43,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:43,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:43,764 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-19 10:11:43,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 10:11:43,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,856 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:43,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689761502647Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689761503296 (+649 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761503296Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761503297 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761503305 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689761503357 (+52 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689761503855 (+498 ms) 2023-07-19 10:11:43,859 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:43,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2100 sec 2023-07-19 10:11:44,765 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:44,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:44,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:44,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:44,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:11:44,774 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,774 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:44,775 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:11:44,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:44,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761504787 (current time:1689761504787). 2023-07-19 10:11:44,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:44,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x48ca640b to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1330aa2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:44,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:44,806 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:44,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48ca640b to 127.0.0.1:54485 2023-07-19 10:11:44,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:44,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x0524f5da to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:44,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ed52349, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:44,831 DEBUG [hconnection-0x8a28b75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:44,834 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:44,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:44,842 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:44,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0524f5da to 127.0.0.1:54485 2023-07-19 10:11:44,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:44,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 10:11:44,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:44,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:44,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:44,858 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:44,859 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689762104859 2023-07-19 10:11:44,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 10:11:44,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,862 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:44,863 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:44,868 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 10:11:44,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:44,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 19 msec 2023-07-19 10:11:44,871 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:44,872 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689762104872 2023-07-19 10:11:44,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,901 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 10:11:44,901 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:44,903 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 10:11:44,903 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 10:11:44,904 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,904 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,906 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,906 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:44,906 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:44,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:44,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:44,906 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:44,906 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:44,906 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,907 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,907 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:44,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 10:11:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:44,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:44,911 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:44,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,912 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 10:11:44,912 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:44,913 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:44,914 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:44,912 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:44,914 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 10:11:44,914 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:44,914 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:44,914 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 10:11:44,914 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 10:11:44,916 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,916 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,916 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,916 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,916 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,916 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:44,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:44,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d986b71[Count = 1] remaining members to acquire global barrier 2023-07-19 10:11:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:44,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 10:11:44,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d986b71[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:44,922 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 10:11:44,923 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,924 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,924 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,924 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 10:11:44,925 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:44,925 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:44,926 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:44,926 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:44,926 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:44,926 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:44,926 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:44,926 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. started... 2023-07-19 10:11:44,926 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8339fb9a13073d13587ab9e7ce027680 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 10:11:44,926 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:44,926 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. started... 2023-07-19 10:11:44,927 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fa849a5f7f8c806cc4cbf918fa20a4c1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 10:11:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:44,960 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071998018afa2b1a4c88b0d65d956e039497 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071998018afa2b1a4c88b0d65d956e039497 2023-07-19 10:11:44,963 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:44,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:44,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:44,964 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:44,980 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307196069f993a2b64d36af9e7f8492d6bef3 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307196069f993a2b64d36af9e7f8492d6bef3 2023-07-19 10:11:44,986 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/.tmp/cf/7ffbe569758e420d9c96863d32180571 2023-07-19 10:11:44,989 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/.tmp/cf/f3254367f71e494aac6b1d25d158dbfe 2023-07-19 10:11:44,992 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/.tmp/cf/7ffbe569758e420d9c96863d32180571 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf/7ffbe569758e420d9c96863d32180571 2023-07-19 10:11:44,995 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/.tmp/cf/f3254367f71e494aac6b1d25d158dbfe as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf/f3254367f71e494aac6b1d25d158dbfe 2023-07-19 10:11:44,998 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf/7ffbe569758e420d9c96863d32180571, entries=47, sequenceid=6, filesize=13.5 K 2023-07-19 10:11:44,999 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for fa849a5f7f8c806cc4cbf918fa20a4c1 in 72ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:44,999 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 10:11:45,000 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa849a5f7f8c806cc4cbf918fa20a4c1: 2023-07-19 10:11:45,000 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,000 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:45,000 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf/7ffbe569758e420d9c96863d32180571] hfiles 2023-07-19 10:11:45,000 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf/7ffbe569758e420d9c96863d32180571 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,003 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf/f3254367f71e494aac6b1d25d158dbfe, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 10:11:45,004 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8339fb9a13073d13587ab9e7ce027680 in 78ms, sequenceid=6, compaction requested=false 2023-07-19 10:11:45,006 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8339fb9a13073d13587ab9e7ce027680: 2023-07-19 10:11:45,006 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,006 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:45,006 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf/f3254367f71e494aac6b1d25d158dbfe] hfiles 2023-07-19 10:11:45,006 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf/f3254367f71e494aac6b1d25d158dbfe for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,019 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. completed. 2023-07-19 10:11:45,019 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:11:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:11:45,021 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:45,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:45,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:11:45,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 10:11:45,028 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. completed. 2023-07-19 10:11:45,028 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:11:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 10:11:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:11:45,030 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,030 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 10:11:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:45,030 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,030 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 10:11:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43767,1689761420847': 2023-07-19 10:11:45,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 10:11:45,035 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 10:11:45,035 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:45,036 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:45,036 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,036 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:45,042 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,042 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,042 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:45,042 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,042 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,042 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,043 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,044 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,047 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,051 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,051 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:45,052 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,054 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,054 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,055 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:45,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:45,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,055 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,057 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:45,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:45,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,057 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:11:45,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,057 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,058 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,058 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:45,058 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,058 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,058 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:45,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071998018afa2b1a4c88b0d65d956e039497, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307196069f993a2b64d36af9e7f8492d6bef3] mob files 2023-07-19 10:11:45,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071998018afa2b1a4c88b0d65d956e039497 2023-07-19 10:11:45,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307196069f993a2b64d36af9e7f8492d6bef3 2023-07-19 10:11:45,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 10:11:45,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,105 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:11:45,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689761504860Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689761505066 (+206 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689761505066Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689761505066Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689761505072 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689761505080 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689761505104 (+24 ms) 2023-07-19 10:11:45,108 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 10:11:45,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 248 msec 2023-07-19 10:11:45,165 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:45,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 10:11:45,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:45,194 DEBUG [Listener at jenkins-hbase4.apache.org/43315] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:11:45,198 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:11:45,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 10:11:45,200 DEBUG [Listener at jenkins-hbase4.apache.org/43315] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:11:45,203 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:11:45,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41773] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 10:11:45,204 DEBUG [Listener at jenkins-hbase4.apache.org/43315] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 10:11:45,206 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 10:11:45,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 10:11:45,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 10:11:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:45,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:11:45,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 10:11:45,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:45,213 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:11:45,215 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,215 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,215 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 empty. 2023-07-19 10:11:45,215 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 empty. 2023-07-19 10:11:45,216 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,216 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,216 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 10:11:45,226 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 10:11:45,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 589075b0d4b73a08a496cb1b5e5fc083, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:11:45,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => b6d6304a7a4d6825b22fa171c7604037, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:11:45,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:45,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:45,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing b6d6304a7a4d6825b22fa171c7604037, disabling compactions & flushes 2023-07-19 10:11:45,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 589075b0d4b73a08a496cb1b5e5fc083, disabling compactions & flushes 2023-07-19 10:11:45,242 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,242 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,243 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. after waiting 0 ms 2023-07-19 10:11:45,243 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,243 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. after waiting 0 ms 2023-07-19 10:11:45,243 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,243 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,243 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,243 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for b6d6304a7a4d6825b22fa171c7604037: 2023-07-19 10:11:45,243 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 589075b0d4b73a08a496cb1b5e5fc083: 2023-07-19 10:11:45,245 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:11:45,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761505246"}]},"ts":"1689761505246"} 2023-07-19 10:11:45,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761505246"}]},"ts":"1689761505246"} 2023-07-19 10:11:45,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:11:45,249 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:11:45,249 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761505249"}]},"ts":"1689761505249"} 2023-07-19 10:11:45,250 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 10:11:45,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:11:45,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:11:45,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:11:45,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:11:45,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:11:45,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, ASSIGN}] 2023-07-19 10:11:45,257 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, ASSIGN 2023-07-19 10:11:45,257 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, ASSIGN 2023-07-19 10:11:45,258 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:11:45,258 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1689761420784; forceNewPlan=false, retain=false 2023-07-19 10:11:45,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:45,408 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:11:45,411 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=589075b0d4b73a08a496cb1b5e5fc083, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,411 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b6d6304a7a4d6825b22fa171c7604037, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,411 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761505411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761505411"}]},"ts":"1689761505411"} 2023-07-19 10:11:45,411 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761505411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761505411"}]},"ts":"1689761505411"} 2023-07-19 10:11:45,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 589075b0d4b73a08a496cb1b5e5fc083, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:11:45,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure b6d6304a7a4d6825b22fa171c7604037, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:11:45,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0004_000001 (auth:SIMPLE) 2023-07-19 10:11:45,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:45,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6d6304a7a4d6825b22fa171c7604037, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 10:11:45,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 589075b0d4b73a08a496cb1b5e5fc083, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 10:11:45,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. service=AccessControlService 2023-07-19 10:11:45,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:45,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:45,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. service=AccessControlService 2023-07-19 10:11:45,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:45,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:45,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,580 INFO [StoreOpener-b6d6304a7a4d6825b22fa171c7604037-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,580 INFO [StoreOpener-589075b0d4b73a08a496cb1b5e5fc083-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,582 DEBUG [StoreOpener-589075b0d4b73a08a496cb1b5e5fc083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf 2023-07-19 10:11:45,582 DEBUG [StoreOpener-589075b0d4b73a08a496cb1b5e5fc083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf 2023-07-19 10:11:45,582 DEBUG [StoreOpener-b6d6304a7a4d6825b22fa171c7604037-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf 2023-07-19 10:11:45,582 DEBUG [StoreOpener-b6d6304a7a4d6825b22fa171c7604037-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf 2023-07-19 10:11:45,582 INFO [StoreOpener-589075b0d4b73a08a496cb1b5e5fc083-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 589075b0d4b73a08a496cb1b5e5fc083 columnFamilyName cf 2023-07-19 10:11:45,582 INFO [StoreOpener-b6d6304a7a4d6825b22fa171c7604037-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6d6304a7a4d6825b22fa171c7604037 columnFamilyName cf 2023-07-19 10:11:45,583 INFO [StoreOpener-b6d6304a7a4d6825b22fa171c7604037-1] regionserver.HStore(310): Store=b6d6304a7a4d6825b22fa171c7604037/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:45,583 INFO [StoreOpener-589075b0d4b73a08a496cb1b5e5fc083-1] regionserver.HStore(310): Store=589075b0d4b73a08a496cb1b5e5fc083/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:45,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:45,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:45,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:11:45,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 589075b0d4b73a08a496cb1b5e5fc083; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67811588, jitterRate=0.0104714035987854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:45,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b6d6304a7a4d6825b22fa171c7604037; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72662749, jitterRate=0.08275933563709259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:45,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 589075b0d4b73a08a496cb1b5e5fc083: 2023-07-19 10:11:45,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b6d6304a7a4d6825b22fa171c7604037: 2023-07-19 10:11:45,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037., pid=70, masterSystemTime=1689761505571 2023-07-19 10:11:45,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083., pid=69, masterSystemTime=1689761505571 2023-07-19 10:11:45,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:45,597 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=589075b0d4b73a08a496cb1b5e5fc083, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761505597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761505597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761505597"}]},"ts":"1689761505597"} 2023-07-19 10:11:45,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:45,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b6d6304a7a4d6825b22fa171c7604037, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761505598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761505598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761505598"}]},"ts":"1689761505598"} 2023-07-19 10:11:45,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 10:11:45,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 589075b0d4b73a08a496cb1b5e5fc083, server=jenkins-hbase4.apache.org,41773,1689761420713 in 186 msec 2023-07-19 10:11:45,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, ASSIGN in 346 msec 2023-07-19 10:11:45,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 10:11:45,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure b6d6304a7a4d6825b22fa171c7604037, server=jenkins-hbase4.apache.org,36483,1689761420784 in 187 msec 2023-07-19 10:11:45,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 10:11:45,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, ASSIGN in 350 msec 2023-07-19 10:11:45,609 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:11:45,609 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761505609"}]},"ts":"1689761505609"} 2023-07-19 10:11:45,611 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 10:11:45,613 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:11:45,613 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 10:11:45,615 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 10:11:45,616 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:45,616 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:45,617 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:45,617 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:11:45,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 10:11:45,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 409 msec 2023-07-19 10:11:45,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 10:11:45,816 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 10:11:45,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 589075b0d4b73a08a496cb1b5e5fc083, b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:45,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[589075b0d4b73a08a496cb1b5e5fc083, b6d6304a7a4d6825b22fa171c7604037], force=true 2023-07-19 10:11:45,851 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[589075b0d4b73a08a496cb1b5e5fc083, b6d6304a7a4d6825b22fa171c7604037], force=true 2023-07-19 10:11:45,851 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[589075b0d4b73a08a496cb1b5e5fc083, b6d6304a7a4d6825b22fa171c7604037], force=true 2023-07-19 10:11:45,851 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[589075b0d4b73a08a496cb1b5e5fc083, b6d6304a7a4d6825b22fa171c7604037], force=true 2023-07-19 10:11:45,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:45,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, UNASSIGN}] 2023-07-19 10:11:45,879 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, UNASSIGN 2023-07-19 10:11:45,879 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, UNASSIGN 2023-07-19 10:11:45,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=589075b0d4b73a08a496cb1b5e5fc083, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:45,880 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b6d6304a7a4d6825b22fa171c7604037, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:45,880 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761505880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761505880"}]},"ts":"1689761505880"} 2023-07-19 10:11:45,881 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761505880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761505880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761505880"}]},"ts":"1689761505880"} 2023-07-19 10:11:45,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 589075b0d4b73a08a496cb1b5e5fc083, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:11:45,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure b6d6304a7a4d6825b22fa171c7604037, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:11:45,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:46,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:46,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 589075b0d4b73a08a496cb1b5e5fc083, disabling compactions & flushes 2023-07-19 10:11:46,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:46,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:46,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. after waiting 0 ms 2023-07-19 10:11:46,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:46,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:46,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 589075b0d4b73a08a496cb1b5e5fc083 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 10:11:46,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b6d6304a7a4d6825b22fa171c7604037, disabling compactions & flushes 2023-07-19 10:11:46,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:46,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:46,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. after waiting 0 ms 2023-07-19 10:11:46,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:46,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b6d6304a7a4d6825b22fa171c7604037 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 10:11:46,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/.tmp/cf/be1befa1a82943c7a5e89dab4fd96d62 2023-07-19 10:11:46,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/.tmp/cf/2451fd0346904c9d8ab7398e79bc9760 2023-07-19 10:11:46,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/.tmp/cf/2451fd0346904c9d8ab7398e79bc9760 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf/2451fd0346904c9d8ab7398e79bc9760 2023-07-19 10:11:46,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/.tmp/cf/be1befa1a82943c7a5e89dab4fd96d62 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf/be1befa1a82943c7a5e89dab4fd96d62 2023-07-19 10:11:46,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf/2451fd0346904c9d8ab7398e79bc9760, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 10:11:46,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf/be1befa1a82943c7a5e89dab4fd96d62, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 10:11:46,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 589075b0d4b73a08a496cb1b5e5fc083 in 62ms, sequenceid=5, compaction requested=false 2023-07-19 10:11:46,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b6d6304a7a4d6825b22fa171c7604037 in 60ms, sequenceid=5, compaction requested=false 2023-07-19 10:11:46,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 10:11:46,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 10:11:46,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 10:11:46,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:46,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083. 2023-07-19 10:11:46,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 589075b0d4b73a08a496cb1b5e5fc083: 2023-07-19 10:11:46,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:11:46,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=589075b0d4b73a08a496cb1b5e5fc083, regionState=CLOSED 2023-07-19 10:11:46,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761506138"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761506138"}]},"ts":"1689761506138"} 2023-07-19 10:11:46,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 10:11:46,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:11:46,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037. 2023-07-19 10:11:46,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b6d6304a7a4d6825b22fa171c7604037: 2023-07-19 10:11:46,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:11:46,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-19 10:11:46,143 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b6d6304a7a4d6825b22fa171c7604037, regionState=CLOSED 2023-07-19 10:11:46,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689761506143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761506143"}]},"ts":"1689761506143"} 2023-07-19 10:11:46,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 589075b0d4b73a08a496cb1b5e5fc083, server=jenkins-hbase4.apache.org,41773,1689761420713 in 258 msec 2023-07-19 10:11:46,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=589075b0d4b73a08a496cb1b5e5fc083, UNASSIGN in 270 msec 2023-07-19 10:11:46,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-19 10:11:46,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure b6d6304a7a4d6825b22fa171c7604037, server=jenkins-hbase4.apache.org,36483,1689761420784 in 262 msec 2023-07-19 10:11:46,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-19 10:11:46,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b6d6304a7a4d6825b22fa171c7604037, UNASSIGN in 274 msec 2023-07-19 10:11:46,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:46,252 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 10:11:46,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505208.589075b0d4b73a08a496cb1b5e5fc083.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:46,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689761505208.b6d6304a7a4d6825b22fa171c7604037.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:46,255 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 10:11:46,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, ASSIGN}] 2023-07-19 10:11:46,329 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, ASSIGN 2023-07-19 10:11:46,330 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:11:46,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:46,480 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 10:11:46,482 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a399655800361927e185a84f420a2675, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:46,482 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761506482"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761506482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761506482"}]},"ts":"1689761506482"} 2023-07-19 10:11:46,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a399655800361927e185a84f420a2675, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:11:46,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:11:46,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a399655800361927e185a84f420a2675, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.', STARTKEY => '', ENDKEY => ''} 2023-07-19 10:11:46,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. service=AccessControlService 2023-07-19 10:11:46,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:11:46,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a399655800361927e185a84f420a2675 2023-07-19 10:11:46,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:11:46,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a399655800361927e185a84f420a2675 2023-07-19 10:11:46,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a399655800361927e185a84f420a2675 2023-07-19 10:11:46,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/.regioninfo 2023-07-19 10:11:46,667 INFO [StoreOpener-a399655800361927e185a84f420a2675-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a399655800361927e185a84f420a2675 2023-07-19 10:11:46,668 DEBUG [StoreOpener-a399655800361927e185a84f420a2675-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf 2023-07-19 10:11:46,668 DEBUG [StoreOpener-a399655800361927e185a84f420a2675-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf 2023-07-19 10:11:46,668 INFO [StoreOpener-a399655800361927e185a84f420a2675-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a399655800361927e185a84f420a2675 columnFamilyName cf 2023-07-19 10:11:46,706 DEBUG [StoreOpener-a399655800361927e185a84f420a2675-1] regionserver.HStore(539): loaded hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/2451fd0346904c9d8ab7398e79bc9760.589075b0d4b73a08a496cb1b5e5fc083->hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf/2451fd0346904c9d8ab7398e79bc9760-top 2023-07-19 10:11:46,712 DEBUG [StoreOpener-a399655800361927e185a84f420a2675-1] regionserver.HStore(539): loaded hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/be1befa1a82943c7a5e89dab4fd96d62.b6d6304a7a4d6825b22fa171c7604037->hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf/be1befa1a82943c7a5e89dab4fd96d62-top 2023-07-19 10:11:46,713 INFO [StoreOpener-a399655800361927e185a84f420a2675-1] regionserver.HStore(310): Store=a399655800361927e185a84f420a2675/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:11:46,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675 2023-07-19 10:11:46,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675 2023-07-19 10:11:46,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a399655800361927e185a84f420a2675 2023-07-19 10:11:46,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a399655800361927e185a84f420a2675; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74181277, jitterRate=0.10538716614246368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:11:46,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a399655800361927e185a84f420a2675: 2023-07-19 10:11:46,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675., pid=77, masterSystemTime=1689761506636 2023-07-19 10:11:46,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.,because compaction is disabled. 2023-07-19 10:11:46,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:11:46,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:11:46,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a399655800361927e185a84f420a2675, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:46,728 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761506727"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761506727"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761506727"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761506727"}]},"ts":"1689761506727"} 2023-07-19 10:11:46,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 10:11:46,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a399655800361927e185a84f420a2675, server=jenkins-hbase4.apache.org,41773,1689761420713 in 245 msec 2023-07-19 10:11:46,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 10:11:46,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, ASSIGN in 403 msec 2023-07-19 10:11:46,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[589075b0d4b73a08a496cb1b5e5fc083, b6d6304a7a4d6825b22fa171c7604037], force=true in 890 msec 2023-07-19 10:11:46,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 10:11:46,960 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 10:11:46,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 10:11:46,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761506961 (current time:1689761506961). 2023-07-19 10:11:46,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:11:46,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x119bb376 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:46,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f4065d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:46,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:46,974 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x119bb376 to 127.0.0.1:54485 2023-07-19 10:11:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x0c416351 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:11:46,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@408d61ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:11:46,988 DEBUG [hconnection-0x57dc510e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:46,992 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:46,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:11:46,998 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:11:46,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c416351 to 127.0.0.1:54485 2023-07-19 10:11:46,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:11:47,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 10:11:47,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:11:47,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 10:11:47,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 10:11:47,004 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 10:11:47,005 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689762107005 2023-07-19 10:11:47,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 10:11:47,005 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,010 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:11:47,010 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:11:47,011 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 10:11:47,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 10:11:47,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-19 10:11:47,014 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 10:11:47,014 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689762107014 2023-07-19 10:11:47,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,028 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 10:11:47,028 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:47,030 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 10:11:47,030 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 10:11:47,030 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,031 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,033 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:47,033 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:47,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:47,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:47,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:47,033 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:47,033 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:47,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:47,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:47,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,034 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,034 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:11:47,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 10:11:47,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 10:11:47,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,035 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 10:11:47,035 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:47,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,037 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 10:11:47,037 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 10:11:47,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,037 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 10:11:47,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 10:11:47,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 10:11:47,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 10:11:47,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 10:11:47,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,038 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 10:11:47,038 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:47,039 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,039 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,040 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 10:11:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 10:11:47,048 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 10:11:47,049 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,051 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 10:11:47,051 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 10:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 10:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 10:11:47,053 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:47,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:47,054 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,054 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:11:47,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:47,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 10:11:47,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ed4f95f[Count = 0] remaining members to acquire global barrier 2023-07-19 10:11:47,063 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 10:11:47,063 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,065 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,065 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,065 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 10:11:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 10:11:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:11:47,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:11:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 10:11:47,072 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:11:47,072 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. started... 2023-07-19 10:11:47,072 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:11:47,074 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a399655800361927e185a84f420a2675: 2023-07-19 10:11:47,074 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,074 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:11:47,074 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/2451fd0346904c9d8ab7398e79bc9760.589075b0d4b73a08a496cb1b5e5fc083->hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf/2451fd0346904c9d8ab7398e79bc9760-top, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/be1befa1a82943c7a5e89dab4fd96d62.b6d6304a7a4d6825b22fa171c7604037->hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf/be1befa1a82943c7a5e89dab4fd96d62-top] hfiles 2023-07-19 10:11:47,075 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/2451fd0346904c9d8ab7398e79bc9760.589075b0d4b73a08a496cb1b5e5fc083 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,076 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/be1befa1a82943c7a5e89dab4fd96d62.b6d6304a7a4d6825b22fa171c7604037 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 10:11:47,077 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,077 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:11:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 10:11:47,110 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:47,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 10:11:47,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:47,112 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:11:47,133 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. completed. 2023-07-19 10:11:47,134 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:11:47,134 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:11:47,134 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:11:47,134 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,134 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 10:11:47,134 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:11:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 10:11:47,141 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 10:11:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:11:47,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 10:11:47,146 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 10:11:47,147 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:11:47,147 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:11:47,147 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,147 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:47,149 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:11:47,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:47,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:47,149 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:11:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,150 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,150 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:11:47,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,153 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:11:47,153 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,154 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,157 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:47,157 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:47,157 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:47,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:47,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:11:47,158 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,158 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:47,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:47,160 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:11:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-19 10:11:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:11:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:11:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:11:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:11:47,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,312 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:47,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 10:11:47,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:11:47,314 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:11:47,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 10:11:47,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,426 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689761507005Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761507159 (+154 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761507159Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761507195 (+36 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689761507321 (+126 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689761507425 (+104 ms) 2023-07-19 10:11:47,429 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 10:11:47,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 420 msec 2023-07-19 10:11:47,614 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:11:47,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 10:11:47,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:11:47,616 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616 2023-07-19 10:11:47,617 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36553, tgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616, rawTgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:11:47,646 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:11:47,647 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2017724525_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,647 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 10:11:47,657 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:11:47,709 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,709 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,710 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:47,710 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,795 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-8869664209508490676.jar 2023-07-19 10:11:48,796 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,797 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,881 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-3092731564490714559.jar 2023-07-19 10:11:48,882 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,882 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,883 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,884 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,884 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,885 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:11:48,885 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:11:48,886 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:11:48,887 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:11:48,887 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:11:48,888 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:11:48,888 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:11:48,888 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:11:48,889 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:11:48,889 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:11:48,890 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:11:48,890 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:48,891 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:48,892 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:48,892 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:48,892 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:11:48,893 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:48,894 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:11:49,793 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:11:49,796 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 10:11:49,799 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 10:11:49,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:49,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:11:50,462 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0005_000001 (auth:SIMPLE) 2023-07-19 10:11:52,149 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:11:56,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0005_000001 (auth:SIMPLE) 2023-07-19 10:11:59,137 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0005_000001 (auth:SIMPLE) 2023-07-19 10:12:03,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0005_000001 (auth:SIMPLE) 2023-07-19 10:12:05,109 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:12:05,113 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:12:05,128 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,128 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:12:05,129 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:12:05,129 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,130 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 10:12:05,130 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 10:12:05,130 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,130 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 10:12:05,131 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761507616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 10:12:05,139 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 10:12:05,144 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525144"}]},"ts":"1689761525144"} 2023-07-19 10:12:05,146 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 10:12:05,148 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 10:12:05,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, UNASSIGN}] 2023-07-19 10:12:05,151 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, UNASSIGN 2023-07-19 10:12:05,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a399655800361927e185a84f420a2675, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:05,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761525151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761525151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761525151"}]},"ts":"1689761525151"} 2023-07-19 10:12:05,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a399655800361927e185a84f420a2675, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:12:05,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 10:12:05,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a399655800361927e185a84f420a2675 2023-07-19 10:12:05,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a399655800361927e185a84f420a2675, disabling compactions & flushes 2023-07-19 10:12:05,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:12:05,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:12:05,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. after waiting 0 ms 2023-07-19 10:12:05,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:12:05,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 10:12:05,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:05,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675. 2023-07-19 10:12:05,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a399655800361927e185a84f420a2675: 2023-07-19 10:12:05,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a399655800361927e185a84f420a2675 2023-07-19 10:12:05,326 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a399655800361927e185a84f420a2675, regionState=CLOSED 2023-07-19 10:12:05,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689761525326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525326"}]},"ts":"1689761525326"} 2023-07-19 10:12:05,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 10:12:05,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a399655800361927e185a84f420a2675, server=jenkins-hbase4.apache.org,41773,1689761420713 in 178 msec 2023-07-19 10:12:05,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 10:12:05,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a399655800361927e185a84f420a2675, UNASSIGN in 186 msec 2023-07-19 10:12:05,336 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525336"}]},"ts":"1689761525336"} 2023-07-19 10:12:05,337 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 10:12:05,339 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 10:12:05,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 201 msec 2023-07-19 10:12:05,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 10:12:05,447 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 10:12:05,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,454 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,456 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,457 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,460 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,460 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,460 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,460 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,462 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675 2023-07-19 10:12:05,462 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:12:05,462 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:12:05,465 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/recovered.edits] 2023-07-19 10:12:05,466 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/recovered.edits] 2023-07-19 10:12:05,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:05,466 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/recovered.edits] 2023-07-19 10:12:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:05,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 10:12:05,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,468 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,469 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,469 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,469 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,469 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,469 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 10:12:05,472 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf/be1befa1a82943c7a5e89dab4fd96d62 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/cf/be1befa1a82943c7a5e89dab4fd96d62 2023-07-19 10:12:05,473 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf/2451fd0346904c9d8ab7398e79bc9760 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/cf/2451fd0346904c9d8ab7398e79bc9760 2023-07-19 10:12:05,475 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/2451fd0346904c9d8ab7398e79bc9760.589075b0d4b73a08a496cb1b5e5fc083 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/2451fd0346904c9d8ab7398e79bc9760.589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:12:05,479 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/recovered.edits/8.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037/recovered.edits/8.seqid 2023-07-19 10:12:05,479 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/recovered.edits/8.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083/recovered.edits/8.seqid 2023-07-19 10:12:05,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:05,484 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/589075b0d4b73a08a496cb1b5e5fc083 2023-07-19 10:12:05,484 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:12:05,485 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/be1befa1a82943c7a5e89dab4fd96d62.b6d6304a7a4d6825b22fa171c7604037 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/cf/be1befa1a82943c7a5e89dab4fd96d62.b6d6304a7a4d6825b22fa171c7604037 2023-07-19 10:12:05,488 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/recovered.edits/12.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675/recovered.edits/12.seqid 2023-07-19 10:12:05,489 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a399655800361927e185a84f420a2675 2023-07-19 10:12:05,489 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 10:12:05,492 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,495 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 10:12:05,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 10:12:05,513 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,513 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 10:12:05,514 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761525513"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,516 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 10:12:05,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a399655800361927e185a84f420a2675, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689761505209.a399655800361927e185a84f420a2675.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 10:12:05,516 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 10:12:05,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761525516"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,518 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 10:12:05,520 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:05,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 72 msec 2023-07-19 10:12:05,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 10:12:05,572 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 10:12:05,572 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 10:12:05,578 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525578"}]},"ts":"1689761525578"} 2023-07-19 10:12:05,579 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 10:12:05,581 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 10:12:05,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, UNASSIGN}] 2023-07-19 10:12:05,584 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, UNASSIGN 2023-07-19 10:12:05,584 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, UNASSIGN 2023-07-19 10:12:05,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8339fb9a13073d13587ab9e7ce027680, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:05,585 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=fa849a5f7f8c806cc4cbf918fa20a4c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:05,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761525585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761525585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761525585"}]},"ts":"1689761525585"} 2023-07-19 10:12:05,585 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761525585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761525585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761525585"}]},"ts":"1689761525585"} 2023-07-19 10:12:05,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 8339fb9a13073d13587ab9e7ce027680, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:12:05,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure fa849a5f7f8c806cc4cbf918fa20a4c1, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:12:05,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 10:12:05,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:12:05,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8339fb9a13073d13587ab9e7ce027680, disabling compactions & flushes 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fa849a5f7f8c806cc4cbf918fa20a4c1, disabling compactions & flushes 2023-07-19 10:12:05,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:12:05,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. after waiting 0 ms 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. after waiting 0 ms 2023-07-19 10:12:05,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:12:05,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:05,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:05,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:05,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:05,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1. 2023-07-19 10:12:05,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680. 2023-07-19 10:12:05,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fa849a5f7f8c806cc4cbf918fa20a4c1: 2023-07-19 10:12:05,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8339fb9a13073d13587ab9e7ce027680: 2023-07-19 10:12:05,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:12:05,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8339fb9a13073d13587ab9e7ce027680, regionState=CLOSED 2023-07-19 10:12:05,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761525764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525764"}]},"ts":"1689761525764"} 2023-07-19 10:12:05,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:12:05,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=fa849a5f7f8c806cc4cbf918fa20a4c1, regionState=CLOSED 2023-07-19 10:12:05,765 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689761525764"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761525764"}]},"ts":"1689761525764"} 2023-07-19 10:12:05,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 10:12:05,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 10:12:05,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 8339fb9a13073d13587ab9e7ce027680, server=jenkins-hbase4.apache.org,43767,1689761420847 in 179 msec 2023-07-19 10:12:05,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure fa849a5f7f8c806cc4cbf918fa20a4c1, server=jenkins-hbase4.apache.org,41773,1689761420713 in 179 msec 2023-07-19 10:12:05,779 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fa849a5f7f8c806cc4cbf918fa20a4c1, UNASSIGN in 194 msec 2023-07-19 10:12:05,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-19 10:12:05,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8339fb9a13073d13587ab9e7ce027680, UNASSIGN in 194 msec 2023-07-19 10:12:05,780 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761525780"}]},"ts":"1689761525780"} 2023-07-19 10:12:05,782 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 10:12:05,784 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 10:12:05,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 211 msec 2023-07-19 10:12:05,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 10:12:05,880 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 10:12:05,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,885 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,887 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,898 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:12:05,898 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:12:05,899 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,899 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,899 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,899 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 10:12:05,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 10:12:05,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 10:12:05,901 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,901 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,901 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,901 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,901 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,901 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,901 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 10:12:05,901 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:12:05,902 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:05,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 10:12:05,903 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/recovered.edits] 2023-07-19 10:12:05,903 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/recovered.edits] 2023-07-19 10:12:05,908 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf/f3254367f71e494aac6b1d25d158dbfe to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/cf/f3254367f71e494aac6b1d25d158dbfe 2023-07-19 10:12:05,910 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf/7ffbe569758e420d9c96863d32180571 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/cf/7ffbe569758e420d9c96863d32180571 2023-07-19 10:12:05,915 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680/recovered.edits/9.seqid 2023-07-19 10:12:05,916 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8339fb9a13073d13587ab9e7ce027680 2023-07-19 10:12:05,917 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1/recovered.edits/9.seqid 2023-07-19 10:12:05,918 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fa849a5f7f8c806cc4cbf918fa20a4c1 2023-07-19 10:12:05,918 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 10:12:05,918 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 10:12:05,919 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-19 10:12:05,925 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071998018afa2b1a4c88b0d65d956e039497 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071998018afa2b1a4c88b0d65d956e039497 2023-07-19 10:12:05,927 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307196069f993a2b64d36af9e7f8492d6bef3 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307196069f993a2b64d36af9e7f8492d6bef3 2023-07-19 10:12:05,928 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 10:12:05,930 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,937 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 10:12:05,942 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 10:12:05,943 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,943 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 10:12:05,944 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761525943"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,944 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761525943"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,951 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:12:05,951 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8339fb9a13073d13587ab9e7ce027680, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689761501885.8339fb9a13073d13587ab9e7ce027680.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fa849a5f7f8c806cc4cbf918fa20a4c1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689761501885.fa849a5f7f8c806cc4cbf918fa20a4c1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:12:05,951 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 10:12:05,951 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761525951"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:05,953 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 10:12:05,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:05,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 75 msec 2023-07-19 10:12:06,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 10:12:06,004 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 10:12:06,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 10:12:06,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:06,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 10:12:06,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 10:12:06,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 10:12:06,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 10:12:06,054 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 743) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1233300120_1 at /127.0.0.1:33432 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:59512 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4104 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1233300120_1 at /127.0.0.1:58770 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:45951 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:33472 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:58782 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=586 (was 497) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2363 (was 3015) 2023-07-19 10:12:06,054 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 10:12:06,089 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=586, ProcessCount=184, AvailableMemoryMB=2361 2023-07-19 10:12:06,089 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 10:12:06,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 10:12:06,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:06,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:12:06,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 10:12:06,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:12:06,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:06,100 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,100 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,101 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b empty. 2023-07-19 10:12:06,102 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 empty. 2023-07-19 10:12:06,102 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,102 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,102 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 10:12:06,152 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 10:12:06,154 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8a4b61629765312cad52a0e87a4d480b, NAME => 'testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:12:06,154 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 193841b7507f74f33bd6e88dca1ec2a0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:12:06,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:06,209 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:06,209 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8a4b61629765312cad52a0e87a4d480b, disabling compactions & flushes 2023-07-19 10:12:06,209 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,209 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,209 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. after waiting 0 ms 2023-07-19 10:12:06,209 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,209 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,209 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8a4b61629765312cad52a0e87a4d480b: 2023-07-19 10:12:06,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:06,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 193841b7507f74f33bd6e88dca1ec2a0, disabling compactions & flushes 2023-07-19 10:12:06,216 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. after waiting 0 ms 2023-07-19 10:12:06,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,216 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,216 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 193841b7507f74f33bd6e88dca1ec2a0: 2023-07-19 10:12:06,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:12:06,221 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761526221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761526221"}]},"ts":"1689761526221"} 2023-07-19 10:12:06,222 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761526221"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761526221"}]},"ts":"1689761526221"} 2023-07-19 10:12:06,226 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:12:06,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:12:06,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761526227"}]},"ts":"1689761526227"} 2023-07-19 10:12:06,229 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 10:12:06,232 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:12:06,234 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:12:06,234 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:12:06,234 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:12:06,234 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:12:06,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, ASSIGN}] 2023-07-19 10:12:06,237 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, ASSIGN 2023-07-19 10:12:06,237 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, ASSIGN 2023-07-19 10:12:06,238 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1689761420847; forceNewPlan=false, retain=false 2023-07-19 10:12:06,238 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1689761420784; forceNewPlan=false, retain=false 2023-07-19 10:12:06,388 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:12:06,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8a4b61629765312cad52a0e87a4d480b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,391 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=193841b7507f74f33bd6e88dca1ec2a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,392 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761526391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761526391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761526391"}]},"ts":"1689761526391"} 2023-07-19 10:12:06,392 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761526391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761526391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761526391"}]},"ts":"1689761526391"} 2023-07-19 10:12:06,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 8a4b61629765312cad52a0e87a4d480b, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:12:06,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 193841b7507f74f33bd6e88dca1ec2a0, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:12:06,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:06,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a4b61629765312cad52a0e87a4d480b, NAME => 'testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:12:06,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. service=AccessControlService 2023-07-19 10:12:06,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:06,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:06,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 193841b7507f74f33bd6e88dca1ec2a0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:12:06,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. service=AccessControlService 2023-07-19 10:12:06,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:06,555 INFO [StoreOpener-8a4b61629765312cad52a0e87a4d480b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:06,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,557 INFO [StoreOpener-193841b7507f74f33bd6e88dca1ec2a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,557 DEBUG [StoreOpener-8a4b61629765312cad52a0e87a4d480b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf 2023-07-19 10:12:06,557 DEBUG [StoreOpener-8a4b61629765312cad52a0e87a4d480b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf 2023-07-19 10:12:06,558 INFO [StoreOpener-8a4b61629765312cad52a0e87a4d480b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a4b61629765312cad52a0e87a4d480b columnFamilyName cf 2023-07-19 10:12:06,559 DEBUG [StoreOpener-193841b7507f74f33bd6e88dca1ec2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf 2023-07-19 10:12:06,559 DEBUG [StoreOpener-193841b7507f74f33bd6e88dca1ec2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf 2023-07-19 10:12:06,560 INFO [StoreOpener-8a4b61629765312cad52a0e87a4d480b-1] regionserver.HStore(310): Store=8a4b61629765312cad52a0e87a4d480b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:06,560 INFO [StoreOpener-193841b7507f74f33bd6e88dca1ec2a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 193841b7507f74f33bd6e88dca1ec2a0 columnFamilyName cf 2023-07-19 10:12:06,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,561 INFO [StoreOpener-193841b7507f74f33bd6e88dca1ec2a0-1] regionserver.HStore(310): Store=193841b7507f74f33bd6e88dca1ec2a0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:06,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:06,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:06,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:06,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a4b61629765312cad52a0e87a4d480b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69907942, jitterRate=0.04170951247215271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:06,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a4b61629765312cad52a0e87a4d480b: 2023-07-19 10:12:06,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b., pid=93, masterSystemTime=1689761526545 2023-07-19 10:12:06,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:06,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 193841b7507f74f33bd6e88dca1ec2a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60713064, jitterRate=-0.09530484676361084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:06,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 193841b7507f74f33bd6e88dca1ec2a0: 2023-07-19 10:12:06,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0., pid=94, masterSystemTime=1689761526547 2023-07-19 10:12:06,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8a4b61629765312cad52a0e87a4d480b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761526569"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761526569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761526569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761526569"}]},"ts":"1689761526569"} 2023-07-19 10:12:06,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,571 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=193841b7507f74f33bd6e88dca1ec2a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,571 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761526571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761526571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761526571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761526571"}]},"ts":"1689761526571"} 2023-07-19 10:12:06,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 10:12:06,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 8a4b61629765312cad52a0e87a4d480b, server=jenkins-hbase4.apache.org,43767,1689761420847 in 179 msec 2023-07-19 10:12:06,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 10:12:06,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 193841b7507f74f33bd6e88dca1ec2a0, server=jenkins-hbase4.apache.org,36483,1689761420784 in 178 msec 2023-07-19 10:12:06,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, ASSIGN in 341 msec 2023-07-19 10:12:06,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-19 10:12:06,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, ASSIGN in 343 msec 2023-07-19 10:12:06,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:12:06,580 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761526579"}]},"ts":"1689761526579"} 2023-07-19 10:12:06,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 10:12:06,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:12:06,584 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 10:12:06,586 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:12:06,588 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:06,588 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:06,588 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:06,588 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:06,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:06,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:06,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:06,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:06,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 499 msec 2023-07-19 10:12:06,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 10:12:06,706 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 10:12:06,710 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:06,711 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,712 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:06,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761526733 (current time:1689761526733). 2023-07-19 10:12:06,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:06,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x2b5f8984 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:06,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7777d589, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:06,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,753 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b5f8984 to 127.0.0.1:54485 2023-07-19 10:12:06,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:06,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x68dc3650 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:06,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f989166, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:06,770 DEBUG [hconnection-0x768ac081-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,772 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:06,780 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:06,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68dc3650 to 127.0.0.1:54485 2023-07-19 10:12:06,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:06,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:12:06,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:06,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,787 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,788 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762126788 2023-07-19 10:12:06,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:06,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:06,790 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:06,790 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:06,791 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:06,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 10:12:06,796 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:06,799 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762126799 2023-07-19 10:12:06,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,823 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 10:12:06,823 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,825 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 10:12:06,825 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:12:06,886 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,886 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,890 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:06,891 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,891 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,891 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:06,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:06,891 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:06,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:06,892 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,892 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,892 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,897 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,898 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:06,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 10:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:06,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,907 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,907 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,909 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,909 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,909 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,909 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,910 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,910 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:06,910 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:06,910 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,910 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,910 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:06,912 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:06,914 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,914 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,914 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,915 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,915 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,916 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,916 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:06,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343c360[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:06,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:06,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343c360[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:06,922 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:12:06,922 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,924 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,924 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,924 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,924 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:06,925 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,925 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. started... 2023-07-19 10:12:06,924 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:12:06,925 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,925 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:06,925 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:06,926 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 193841b7507f74f33bd6e88dca1ec2a0: 2023-07-19 10:12:06,926 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,926 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:06,926 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:06,926 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:06,926 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:06,926 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,927 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. started... 2023-07-19 10:12:06,927 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a4b61629765312cad52a0e87a4d480b: 2023-07-19 10:12:06,927 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,927 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:06,927 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:06,928 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,929 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,929 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,985 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. completed. 2023-07-19 10:12:06,985 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:12:06,985 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. completed. 2023-07-19 10:12:06,985 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:06,985 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,986 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:06,986 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:12:06,987 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,987 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,987 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,987 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,989 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:06,989 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,989 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:06,989 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:06,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:06,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43767,1689761420847': 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:06,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:06,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:06,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:12:06,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:12:06,997 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 10:12:06,997 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:06,997 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:06,997 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,997 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:06,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:06,999 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,000 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,000 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,001 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,003 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,006 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,006 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,010 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,011 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,011 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,012 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,013 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,013 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,013 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,014 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:12:07,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 10:12:07,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,092 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:07,094 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:12:07,103 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 10:12:07,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,104 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689761526788Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689761527024 (+236 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689761527024Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689761527024Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689761527030 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689761527043 (+13 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689761527103 (+60 ms) 2023-07-19 10:12:07,108 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:07,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 318 msec 2023-07-19 10:12:07,394 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:07,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:07,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:07,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:07,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:07,420 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:07,420 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:07,420 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:07,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761527431 (current time:1689761527431). 2023-07-19 10:12:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x18c09dbe to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:07,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@386ec8ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:07,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:07,446 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:07,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18c09dbe to 127.0.0.1:54485 2023-07-19 10:12:07,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:07,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x0f13add0 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:07,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13a2fce1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:07,463 DEBUG [hconnection-0x5d4567ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:07,466 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:07,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:07,471 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:07,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f13add0 to 127.0.0.1:54485 2023-07-19 10:12:07,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:07,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 10:12:07,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:07,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:07,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:07,477 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:07,478 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689762127478 2023-07-19 10:12:07,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 10:12:07,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:07,478 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:07,478 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:07,481 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 10:12:07,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:07,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 10:12:07,484 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:07,484 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689762127484 2023-07-19 10:12:07,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,510 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 10:12:07,510 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:07,512 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 10:12:07,512 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 10:12:07,512 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,512 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,514 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,514 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,514 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,514 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,514 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,514 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,515 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,515 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:07,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 10:12:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:07,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 10:12:07,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:07,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 10:12:07,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 10:12:07,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,522 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:07,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,522 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:07,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,524 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:07,524 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:07,524 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:07,522 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 10:12:07,525 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:07,527 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:07,524 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:07,527 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:07,526 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:07,527 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:07,531 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 10:12:07,532 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 10:12:07,532 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 10:12:07,533 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,533 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,534 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,534 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:07,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,538 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,542 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,542 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,542 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,542 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:07,543 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,543 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:07,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:07,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350b150e[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 10:12:07,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350b150e[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:07,549 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 10:12:07,549 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,559 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,560 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:07,560 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:07,560 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:12:07,560 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,561 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,561 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:07,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,562 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 10:12:07,563 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,566 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:07,566 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,566 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,566 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:07,566 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:07,574 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:07,580 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:07,580 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:07,580 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:07,580 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:07,580 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:07,580 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. started... 2023-07-19 10:12:07,580 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. started... 2023-07-19 10:12:07,580 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:07,581 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 193841b7507f74f33bd6e88dca1ec2a0 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 10:12:07,581 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a4b61629765312cad52a0e87a4d480b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 10:12:07,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:07,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:07,582 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:07,655 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071905dfdbc9efd0466ea6b79742f1390379 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071905dfdbc9efd0466ea6b79742f1390379 2023-07-19 10:12:07,694 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/.tmp/cf/155b2906275c461690d0feaab6f7d612 2023-07-19 10:12:07,698 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307198e5ba9747b2a4848873c5ac9eadc9ef6 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307198e5ba9747b2a4848873c5ac9eadc9ef6 2023-07-19 10:12:07,701 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/.tmp/cf/155b2906275c461690d0feaab6f7d612 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf/155b2906275c461690d0feaab6f7d612 2023-07-19 10:12:07,707 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf/155b2906275c461690d0feaab6f7d612, entries=45, sequenceid=6, filesize=12.7 K 2023-07-19 10:12:07,708 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 193841b7507f74f33bd6e88dca1ec2a0 in 127ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:07,708 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 10:12:07,709 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 193841b7507f74f33bd6e88dca1ec2a0: 2023-07-19 10:12:07,709 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,716 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:07,716 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf/155b2906275c461690d0feaab6f7d612] hfiles 2023-07-19 10:12:07,716 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf/155b2906275c461690d0feaab6f7d612 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,739 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/.tmp/cf/fffc22362eab4cbea4eb34ea5737e8f6 2023-07-19 10:12:07,751 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/.tmp/cf/fffc22362eab4cbea4eb34ea5737e8f6 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf/fffc22362eab4cbea4eb34ea5737e8f6 2023-07-19 10:12:07,751 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. completed. 2023-07-19 10:12:07,752 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:07,752 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:07,752 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:07,752 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,752 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:07,752 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:12:07,754 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,754 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:07,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,755 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,755 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:12:07,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 10:12:07,763 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf/fffc22362eab4cbea4eb34ea5737e8f6, entries=5, sequenceid=6, filesize=5.8 K 2023-07-19 10:12:07,764 INFO [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 8a4b61629765312cad52a0e87a4d480b in 183ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:07,766 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a4b61629765312cad52a0e87a4d480b: 2023-07-19 10:12:07,767 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,767 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:07,767 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf/fffc22362eab4cbea4eb34ea5737e8f6] hfiles 2023-07-19 10:12:07,767 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf/fffc22362eab4cbea4eb34ea5737e8f6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,781 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. completed. 2023-07-19 10:12:07,781 DEBUG [rs(jenkins-hbase4.apache.org,43767,1689761420847)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:07,781 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:07,781 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:07,781 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,781 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 10:12:07,781 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:12:07,782 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:07,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:07,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:07,783 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 10:12:07,783 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,783 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 10:12:07,783 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,787 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:12:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43767,1689761420847': 2023-07-19 10:12:07,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 10:12:07,792 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 10:12:07,792 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:07,792 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:07,792 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,792 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:07,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:07,795 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,796 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,797 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,800 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:07,800 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,801 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:07,804 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:07,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,804 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:07,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:07,804 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:07,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:07,810 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,811 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:07,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:07,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:12:07,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071905dfdbc9efd0466ea6b79742f1390379, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307198e5ba9747b2a4848873c5ac9eadc9ef6] mob files 2023-07-19 10:12:07,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071905dfdbc9efd0466ea6b79742f1390379 2023-07-19 10:12:07,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307198e5ba9747b2a4848873c5ac9eadc9ef6 2023-07-19 10:12:07,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 10:12:07,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,963 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:07,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689761527478Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689761527837 (+359 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689761527837Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689761527837Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689761527851 (+14 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689761527872 (+21 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689761527962 (+90 ms) 2023-07-19 10:12:07,969 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 10:12:07,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 489 msec 2023-07-19 10:12:08,087 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:08,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 10:12:08,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:08,090 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090 2023-07-19 10:12:08,090 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36553, tgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090, rawTgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:12:08,120 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:12:08,120 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1096327160_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:08,120 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 10:12:08,131 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:08,209 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,210 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,210 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:08,210 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0005_000001 (auth:SIMPLE) 2023-07-19 10:12:09,419 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-406386161445420418.jar 2023-07-19 10:12:09,419 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,420 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,506 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-3694100317738387732.jar 2023-07-19 10:12:09,507 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,507 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,508 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,508 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,509 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,509 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:09,509 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:12:09,510 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:12:09,510 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:12:09,511 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:12:09,511 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:12:09,512 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:12:09,512 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:12:09,512 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:12:09,513 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:12:09,513 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:12:09,514 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,514 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,515 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:09,515 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,515 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:09,516 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:09,516 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:10,235 WARN [DataStreamer for file /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689761429945_0006/libjars/zookeeper-3.5.7.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-19 10:12:10,832 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:12:10,835 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 10:12:10,953 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:10,953 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:11,041 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:12:11,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0006_000001 (auth:SIMPLE) 2023-07-19 10:12:18,083 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0006_000001 (auth:SIMPLE) 2023-07-19 10:12:21,301 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:12:21,302 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:12:21,311 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:21,311 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:12:21,311 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:12:21,312 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:21,312 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 10:12:21,312 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 10:12:21,312 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:21,313 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 10:12:21,313 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761528090/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 10:12:21,321 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 10:12:21,327 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761541327"}]},"ts":"1689761541327"} 2023-07-19 10:12:21,328 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 10:12:21,330 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 10:12:21,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, UNASSIGN}] 2023-07-19 10:12:21,331 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, UNASSIGN 2023-07-19 10:12:21,333 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, UNASSIGN 2023-07-19 10:12:21,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8a4b61629765312cad52a0e87a4d480b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:21,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=193841b7507f74f33bd6e88dca1ec2a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:21,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761541333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761541333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761541333"}]},"ts":"1689761541333"} 2023-07-19 10:12:21,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761541333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761541333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761541333"}]},"ts":"1689761541333"} 2023-07-19 10:12:21,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 8a4b61629765312cad52a0e87a4d480b, server=jenkins-hbase4.apache.org,43767,1689761420847}] 2023-07-19 10:12:21,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 193841b7507f74f33bd6e88dca1ec2a0, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:12:21,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 10:12:21,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:21,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a4b61629765312cad52a0e87a4d480b, disabling compactions & flushes 2023-07-19 10:12:21,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:21,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:21,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. after waiting 0 ms 2023-07-19 10:12:21,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:21,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:21,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 193841b7507f74f33bd6e88dca1ec2a0, disabling compactions & flushes 2023-07-19 10:12:21,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:21,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:21,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. after waiting 0 ms 2023-07-19 10:12:21,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:21,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:21,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:21,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:21,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b. 2023-07-19 10:12:21,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a4b61629765312cad52a0e87a4d480b: 2023-07-19 10:12:21,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:21,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0. 2023-07-19 10:12:21,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 193841b7507f74f33bd6e88dca1ec2a0: 2023-07-19 10:12:21,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:21,530 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8a4b61629765312cad52a0e87a4d480b, regionState=CLOSED 2023-07-19 10:12:21,530 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761541530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761541530"}]},"ts":"1689761541530"} 2023-07-19 10:12:21,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:21,531 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=193841b7507f74f33bd6e88dca1ec2a0, regionState=CLOSED 2023-07-19 10:12:21,531 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689761541531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761541531"}]},"ts":"1689761541531"} 2023-07-19 10:12:21,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 10:12:21,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 8a4b61629765312cad52a0e87a4d480b, server=jenkins-hbase4.apache.org,43767,1689761420847 in 197 msec 2023-07-19 10:12:21,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 10:12:21,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 193841b7507f74f33bd6e88dca1ec2a0, server=jenkins-hbase4.apache.org,36483,1689761420784 in 197 msec 2023-07-19 10:12:21,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a4b61629765312cad52a0e87a4d480b, UNASSIGN in 204 msec 2023-07-19 10:12:21,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-19 10:12:21,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=193841b7507f74f33bd6e88dca1ec2a0, UNASSIGN in 205 msec 2023-07-19 10:12:21,538 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761541538"}]},"ts":"1689761541538"} 2023-07-19 10:12:21,539 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 10:12:21,541 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 10:12:21,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 220 msec 2023-07-19 10:12:21,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 10:12:21,630 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 10:12:21,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,637 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,639 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,643 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,645 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:21,645 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:21,646 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,646 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,646 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,646 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:21,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:21,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:21,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,649 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,648 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:21,649 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/recovered.edits] 2023-07-19 10:12:21,649 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/recovered.edits] 2023-07-19 10:12:21,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 10:12:21,654 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf/155b2906275c461690d0feaab6f7d612 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/cf/155b2906275c461690d0feaab6f7d612 2023-07-19 10:12:21,655 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf/fffc22362eab4cbea4eb34ea5737e8f6 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/cf/fffc22362eab4cbea4eb34ea5737e8f6 2023-07-19 10:12:21,658 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0/recovered.edits/9.seqid 2023-07-19 10:12:21,658 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/193841b7507f74f33bd6e88dca1ec2a0 2023-07-19 10:12:21,659 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b/recovered.edits/9.seqid 2023-07-19 10:12:21,660 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a4b61629765312cad52a0e87a4d480b 2023-07-19 10:12:21,660 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 10:12:21,660 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 10:12:21,661 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-19 10:12:21,665 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071905dfdbc9efd0466ea6b79742f1390379 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071905dfdbc9efd0466ea6b79742f1390379 2023-07-19 10:12:21,666 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307198e5ba9747b2a4848873c5ac9eadc9ef6 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307198e5ba9747b2a4848873c5ac9eadc9ef6 2023-07-19 10:12:21,667 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 10:12:21,671 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,688 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 10:12:21,699 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 10:12:21,701 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,701 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 10:12:21,701 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761541701"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:21,701 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761541701"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:21,713 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:12:21,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8a4b61629765312cad52a0e87a4d480b, NAME => 'testtb-testEmptyExportFileSystemState,,1689761526091.8a4b61629765312cad52a0e87a4d480b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 193841b7507f74f33bd6e88dca1ec2a0, NAME => 'testtb-testEmptyExportFileSystemState,1,1689761526091.193841b7507f74f33bd6e88dca1ec2a0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:12:21,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 10:12:21,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761541714"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:21,717 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 10:12:21,720 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 10:12:21,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 89 msec 2023-07-19 10:12:21,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 10:12:21,751 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 10:12:21,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 10:12:21,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:21,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 10:12:21,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 10:12:21,808 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1583346549_1 at /127.0.0.1:51552 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:39127 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4793 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:40882 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1583346549_1 at /127.0.0.1:59426 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:45466 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:38788 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=608 (was 586) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1714 (was 2361) 2023-07-19 10:12:21,808 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-19 10:12:21,853 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=608, ProcessCount=184, AvailableMemoryMB=1713 2023-07-19 10:12:21,854 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-19 10:12:21,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 10:12:21,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:21,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 10:12:21,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 10:12:21,862 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 10:12:21,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:21,866 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:21,867 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:21,867 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b empty. 2023-07-19 10:12:21,868 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 empty. 2023-07-19 10:12:21,868 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:21,868 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:21,868 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 10:12:21,901 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 10:12:21,903 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 798ff8c1b3bbc4233e45a904a372078b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:12:21,903 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 69444aea8b637000b8d79f0903d25442, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp 2023-07-19 10:12:21,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:21,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 798ff8c1b3bbc4233e45a904a372078b, disabling compactions & flushes 2023-07-19 10:12:21,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:21,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:21,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. after waiting 0 ms 2023-07-19 10:12:21,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:21,937 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:21,937 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 798ff8c1b3bbc4233e45a904a372078b: 2023-07-19 10:12:21,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:21,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 69444aea8b637000b8d79f0903d25442, disabling compactions & flushes 2023-07-19 10:12:21,952 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:21,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:21,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. after waiting 0 ms 2023-07-19 10:12:21,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:21,952 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:21,952 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 69444aea8b637000b8d79f0903d25442: 2023-07-19 10:12:21,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 10:12:21,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761541959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761541959"}]},"ts":"1689761541959"} 2023-07-19 10:12:21,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761541959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761541959"}]},"ts":"1689761541959"} 2023-07-19 10:12:21,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 10:12:21,962 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 10:12:21,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761541962"}]},"ts":"1689761541962"} 2023-07-19 10:12:21,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:21,965 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 10:12:21,971 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 10:12:21,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 10:12:21,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 10:12:21,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 10:12:21,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 10:12:21,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, ASSIGN}] 2023-07-19 10:12:21,975 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, ASSIGN 2023-07-19 10:12:21,975 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, ASSIGN 2023-07-19 10:12:21,977 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41773,1689761420713; forceNewPlan=false, retain=false 2023-07-19 10:12:21,977 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1689761420784; forceNewPlan=false, retain=false 2023-07-19 10:12:22,128 INFO [jenkins-hbase4:38127] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 10:12:22,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=69444aea8b637000b8d79f0903d25442, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=798ff8c1b3bbc4233e45a904a372078b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,133 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761542133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761542133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761542133"}]},"ts":"1689761542133"} 2023-07-19 10:12:22,133 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761542133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761542133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761542133"}]},"ts":"1689761542133"} 2023-07-19 10:12:22,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 798ff8c1b3bbc4233e45a904a372078b, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:12:22,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 69444aea8b637000b8d79f0903d25442, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:12:22,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:22,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 798ff8c1b3bbc4233e45a904a372078b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 10:12:22,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. service=AccessControlService 2023-07-19 10:12:22,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:22,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:22,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,298 INFO [StoreOpener-798ff8c1b3bbc4233e45a904a372078b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,300 DEBUG [StoreOpener-798ff8c1b3bbc4233e45a904a372078b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf 2023-07-19 10:12:22,300 DEBUG [StoreOpener-798ff8c1b3bbc4233e45a904a372078b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf 2023-07-19 10:12:22,300 INFO [StoreOpener-798ff8c1b3bbc4233e45a904a372078b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 798ff8c1b3bbc4233e45a904a372078b columnFamilyName cf 2023-07-19 10:12:22,302 INFO [StoreOpener-798ff8c1b3bbc4233e45a904a372078b-1] regionserver.HStore(310): Store=798ff8c1b3bbc4233e45a904a372078b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:22,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:22,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69444aea8b637000b8d79f0903d25442, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 10:12:22,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. service=AccessControlService 2023-07-19 10:12:22,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 10:12:22,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 10:12:22,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,311 INFO [StoreOpener-69444aea8b637000b8d79f0903d25442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:22,315 DEBUG [StoreOpener-69444aea8b637000b8d79f0903d25442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf 2023-07-19 10:12:22,315 DEBUG [StoreOpener-69444aea8b637000b8d79f0903d25442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf 2023-07-19 10:12:22,316 INFO [StoreOpener-69444aea8b637000b8d79f0903d25442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69444aea8b637000b8d79f0903d25442 columnFamilyName cf 2023-07-19 10:12:22,317 INFO [StoreOpener-69444aea8b637000b8d79f0903d25442-1] regionserver.HStore(310): Store=69444aea8b637000b8d79f0903d25442/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 10:12:22,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:22,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 798ff8c1b3bbc4233e45a904a372078b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73435452, jitterRate=0.09427350759506226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:22,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 798ff8c1b3bbc4233e45a904a372078b: 2023-07-19 10:12:22,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b., pid=108, masterSystemTime=1689761542291 2023-07-19 10:12:22,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,320 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=798ff8c1b3bbc4233e45a904a372078b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,321 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761542320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761542320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761542320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761542320"}]},"ts":"1689761542320"} 2023-07-19 10:12:22,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:22,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 10:12:22,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69444aea8b637000b8d79f0903d25442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60865025, jitterRate=-0.09304045140743256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 10:12:22,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69444aea8b637000b8d79f0903d25442: 2023-07-19 10:12:22,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 10:12:22,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442., pid=109, masterSystemTime=1689761542299 2023-07-19 10:12:22,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 798ff8c1b3bbc4233e45a904a372078b, server=jenkins-hbase4.apache.org,36483,1689761420784 in 185 msec 2023-07-19 10:12:22,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:22,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:22,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, ASSIGN in 352 msec 2023-07-19 10:12:22,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=69444aea8b637000b8d79f0903d25442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761542327"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689761542327"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689761542327"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689761542327"}]},"ts":"1689761542327"} 2023-07-19 10:12:22,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 10:12:22,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 69444aea8b637000b8d79f0903d25442, server=jenkins-hbase4.apache.org,41773,1689761420713 in 188 msec 2023-07-19 10:12:22,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 10:12:22,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, ASSIGN in 358 msec 2023-07-19 10:12:22,334 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 10:12:22,334 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761542334"}]},"ts":"1689761542334"} 2023-07-19 10:12:22,335 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 10:12:22,338 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 10:12:22,339 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 10:12:22,340 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 10:12:22,342 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:22,342 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:22,342 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:22,342 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:22,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:22,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:22,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:22,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 10:12:22,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 487 msec 2023-07-19 10:12:22,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 10:12:22,467 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 10:12:22,469 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,469 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,471 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:22,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:22,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761542482 (current time:1689761542482). 2023-07-19 10:12:22,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:22,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x33e251ef to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:22,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51c6b7d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:22,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:22,492 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:22,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33e251ef to 127.0.0.1:54485 2023-07-19 10:12:22,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:22,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x0187f9d0 to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:22,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@204bad26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:22,500 DEBUG [hconnection-0x44d7d6fe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:22,507 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:22,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:22,513 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0187f9d0 to 127.0.0.1:54485 2023-07-19 10:12:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 10:12:22,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:22,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:22,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:22,522 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:22,523 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689762142523 2023-07-19 10:12:22,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:22,523 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,525 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:22,525 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:22,528 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:22,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:22,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-19 10:12:22,530 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:22,532 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689762142532 2023-07-19 10:12:22,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,553 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 10:12:22,553 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,555 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 10:12:22,555 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 10:12:22,555 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,555 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,556 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,556 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,556 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,556 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,557 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,557 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,557 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,557 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:22,558 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:22,558 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:22,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,560 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:22,560 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:22,560 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,560 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:22,561 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,562 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:22,562 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:22,562 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:22,570 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,570 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,570 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,571 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,571 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:22,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:22,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b06333d[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:22,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b06333d[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:22,576 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 10:12:22,576 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,577 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:22,577 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,577 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:22,577 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:22,577 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:12:22,577 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:22,578 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,578 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:22,578 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:22,578 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:22,578 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. started... 2023-07-19 10:12:22,579 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,579 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69444aea8b637000b8d79f0903d25442: 2023-07-19 10:12:22,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:22,579 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,579 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:22,579 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:22,580 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:22,580 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,580 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. started... 2023-07-19 10:12:22,580 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 798ff8c1b3bbc4233e45a904a372078b: 2023-07-19 10:12:22,580 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:22,580 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:22,580 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,580 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:22,586 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:22,587 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 10:12:22,598 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. completed. 2023-07-19 10:12:22,598 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:22,598 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:12:22,601 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,601 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,601 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:22,601 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:12:22,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 10:12:22,616 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. completed. 2023-07-19 10:12:22,616 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,616 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:22,616 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:22,616 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,617 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:22,617 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:12:22,618 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:22,618 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,618 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:22,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,618 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:12:22,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 10:12:22,623 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 10:12:22,623 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:22,623 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:22,623 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,623 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:22,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,625 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,626 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,625 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,626 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:22,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,627 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,628 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:22,629 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,629 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,632 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,632 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,632 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,632 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:22,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:22,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:22,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:12:22,634 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,635 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,635 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:22,635 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,635 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,635 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 10:12:22,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 10:12:22,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,678 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689761542523Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689761542645 (+122 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761542645Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761542645Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761542648 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689761542655 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689761542678 (+23 ms) 2023-07-19 10:12:22,681 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:22,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 158 msec 2023-07-19 10:12:22,828 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:22,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:22,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:22,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:22,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 10:12:22,835 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,836 DEBUG [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:22,836 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 10:12:22,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:22,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689761542848 (current time:1689761542848). 2023-07-19 10:12:22,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 10:12:22,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x38731f1d to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42694ecb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:22,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:22,875 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:22,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38731f1d to 127.0.0.1:54485 2023-07-19 10:12:22,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:22,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(139): Connect 0x4567fc5e to 127.0.0.1:54485 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 10:12:22,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65cc9818, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 10:12:22,885 DEBUG [hconnection-0x6d5b8d7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:22,886 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:22,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 10:12:22,894 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 10:12:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4567fc5e to 127.0.0.1:54485 2023-07-19 10:12:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:12:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 10:12:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 10:12:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:22,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:22,899 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:22,899 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689762142899 2023-07-19 10:12:22,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 10:12:22,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,901 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 10:12:22,901 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 10:12:22,902 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 10:12:22,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:22,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-19 10:12:22,904 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:22,905 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689762142905 2023-07-19 10:12:22,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,918 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 10:12:22,918 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,921 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 10:12:22,921 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 10:12:22,922 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,922 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,955 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,955 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,955 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:22,955 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:22,955 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,955 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,956 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:22,956 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 10:12:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:22,960 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:22,960 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1689761420847' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 10:12:22,960 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:22,961 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:22,961 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:22,962 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 10:12:22,962 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 10:12:22,962 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 10:12:23,001 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:23,001 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:23,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:23,003 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 10:12:23,070 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,070 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,070 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:23,070 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,070 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,070 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:23,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:23,070 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,071 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:23,071 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,071 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 10:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:23,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41773,1689761420713' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e13303[Count = 1] remaining members to acquire global barrier 2023-07-19 10:12:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1689761420784' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 10:12:23,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e13303[Count = 0] remaining members to acquire global barrier 2023-07-19 10:12:23,077 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 10:12:23,077 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,120 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,120 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,120 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,121 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,121 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:23,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,121 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:23,121 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:23,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,121 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43767,1689761420847' in zk 2023-07-19 10:12:23,121 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 10:12:23,121 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,121 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 10:12:23,121 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:23,121 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:23,122 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:23,122 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. started... 2023-07-19 10:12:23,122 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:23,122 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 10:12:23,122 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 10:12:23,122 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. started... 2023-07-19 10:12:23,122 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 798ff8c1b3bbc4233e45a904a372078b 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 10:12:23,122 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69444aea8b637000b8d79f0903d25442 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 10:12:23,124 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:23,124 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:23,124 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1689761420847' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:23,171 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307191216e9047d904cd4860fad0be38ba4c9 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307191216e9047d904cd4860fad0be38ba4c9 2023-07-19 10:12:23,174 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719de197a9584cb4381b12206a8a4fb9d26 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719de197a9584cb4381b12206a8a4fb9d26 2023-07-19 10:12:23,191 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/.tmp/cf/6e035c646668410ebecfce7a063abef4 2023-07-19 10:12:23,194 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/.tmp/cf/19649ddcc9ab4fc09584e514ad86f4a0 2023-07-19 10:12:23,197 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/.tmp/cf/6e035c646668410ebecfce7a063abef4 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf/6e035c646668410ebecfce7a063abef4 2023-07-19 10:12:23,200 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/.tmp/cf/19649ddcc9ab4fc09584e514ad86f4a0 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf/19649ddcc9ab4fc09584e514ad86f4a0 2023-07-19 10:12:23,202 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf/6e035c646668410ebecfce7a063abef4, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 10:12:23,203 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:23,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:23,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 10:12:23,204 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 10:12:23,205 INFO [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 798ff8c1b3bbc4233e45a904a372078b in 83ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:23,205 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 10:12:23,206 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 798ff8c1b3bbc4233e45a904a372078b: 2023-07-19 10:12:23,206 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,206 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:23,206 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf/6e035c646668410ebecfce7a063abef4] hfiles 2023-07-19 10:12:23,206 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf/6e035c646668410ebecfce7a063abef4 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,207 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf/19649ddcc9ab4fc09584e514ad86f4a0, entries=46, sequenceid=6, filesize=13.2 K 2023-07-19 10:12:23,208 INFO [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 69444aea8b637000b8d79f0903d25442 in 86ms, sequenceid=6, compaction requested=false 2023-07-19 10:12:23,210 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69444aea8b637000b8d79f0903d25442: 2023-07-19 10:12:23,210 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,210 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 10:12:23,210 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf/19649ddcc9ab4fc09584e514ad86f4a0] hfiles 2023-07-19 10:12:23,211 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf/19649ddcc9ab4fc09584e514ad86f4a0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,235 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. completed. 2023-07-19 10:12:23,235 DEBUG [rs(jenkins-hbase4.apache.org,41773,1689761420713)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,239 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:23,239 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41773,1689761420713' in zk 2023-07-19 10:12:23,241 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,241 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,241 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:23,241 DEBUG [member: 'jenkins-hbase4.apache.org,41773,1689761420713' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,245 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. completed. 2023-07-19 10:12:23,245 DEBUG [rs(jenkins-hbase4.apache.org,36483,1689761420784)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 10:12:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 10:12:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 10:12:23,245 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36483,1689761420784' in zk 2023-07-19 10:12:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,248 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,248 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 10:12:23,248 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,248 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1689761420784' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 10:12:23,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41773,1689761420713': 2023-07-19 10:12:23,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41773,1689761420713' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 10:12:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:23,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:23,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:23,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36483,1689761420784': 2023-07-19 10:12:23,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1689761420784' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 10:12:23,257 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 10:12:23,257 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 10:12:23,257 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 10:12:23,257 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,257 INFO [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:23,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 10:12:23,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,259 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:23,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:23,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 10:12:23,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,261 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 10:12:23,261 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,267 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 10:12:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,269 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,269 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,269 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,273 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:23,273 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:23,273 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 10:12:23,273 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:23,273 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:23,273 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 10:12:23,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:23,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:23,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 10:12:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 10:12:23,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:23,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:23,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 10:12:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 10:12:23,274 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,274 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,274 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,274 DEBUG [(jenkins-hbase4.apache.org,38127,1689761419092)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 10:12:23,275 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,275 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,276 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:23,276 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,276 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:12:23,276 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:23,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 10:12:23,276 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,277 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719de197a9584cb4381b12206a8a4fb9d26, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307191216e9047d904cd4860fad0be38ba4c9] mob files 2023-07-19 10:12:23,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719de197a9584cb4381b12206a8a4fb9d26 2023-07-19 10:12:23,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307191216e9047d904cd4860fad0be38ba4c9 2023-07-19 10:12:23,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 10:12:23,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,367 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689761542900Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689761543289 (+389 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689761543289Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689761543289Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689761543299 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689761543312 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689761543366 (+54 ms) 2023-07-19 10:12:23,370 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 10:12:23,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 470 msec 2023-07-19 10:12:23,505 DEBUG [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 10:12:23,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 10:12:23,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 10:12:23,506 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506 2023-07-19 10:12:23,507 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36553, tgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506, rawTgtDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506, srcFsUri=hdfs://localhost:36553, srcDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:12:23,532 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9 2023-07-19 10:12:23,532 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409781803_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,532 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36553, inputRoot=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9, snapshotDir=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 10:12:23,550 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:23,605 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,605 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,606 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:23,606 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,633 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-1457117976410626008.jar 2023-07-19 10:12:24,634 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,634 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,703 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/hadoop-7572001359435375775.jar 2023-07-19 10:12:24,703 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,704 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,704 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,704 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,705 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,705 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 10:12:24,705 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 10:12:24,706 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 10:12:24,706 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 10:12:24,707 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 10:12:24,707 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 10:12:24,707 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 10:12:24,708 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 10:12:24,708 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 10:12:24,708 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 10:12:24,709 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 10:12:24,710 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:24,710 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 10:12:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:24,712 DEBUG [Listener at jenkins-hbase4.apache.org/43315] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 10:12:25,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0006_000001 (auth:SIMPLE) 2023-07-19 10:12:25,718 WARN [Listener at jenkins-hbase4.apache.org/43315] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 10:12:25,721 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 10:12:25,723 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-19 10:12:25,812 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:25,814 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 10:12:26,532 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:27,130 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:12:33,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:35,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:39,728 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689761429945_0007_000001 (auth:SIMPLE) 2023-07-19 10:12:40,988 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 10:12:40,988 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 10:12:41,047 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,047 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 10:12:41,048 INFO [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 10:12:41,048 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 10:12:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 10:12:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740693978_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 10:12:41,050 DEBUG [Listener at jenkins-hbase4.apache.org/43315] snapshot.TestExportSnapshot(367): hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/export-test/export-1689761543506/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 10:12:41,070 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 10:12:41,076 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761561076"}]},"ts":"1689761561076"} 2023-07-19 10:12:41,078 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 10:12:41,081 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 10:12:41,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, UNASSIGN}] 2023-07-19 10:12:41,083 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, UNASSIGN 2023-07-19 10:12:41,085 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, UNASSIGN 2023-07-19 10:12:41,086 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=69444aea8b637000b8d79f0903d25442, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:12:41,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761561086"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761561086"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761561086"}]},"ts":"1689761561086"} 2023-07-19 10:12:41,088 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=798ff8c1b3bbc4233e45a904a372078b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:12:41,088 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761561087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689761561087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689761561087"}]},"ts":"1689761561087"} 2023-07-19 10:12:41,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 798ff8c1b3bbc4233e45a904a372078b, server=jenkins-hbase4.apache.org,36483,1689761420784}] 2023-07-19 10:12:41,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 69444aea8b637000b8d79f0903d25442, server=jenkins-hbase4.apache.org,41773,1689761420713}] 2023-07-19 10:12:41,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 10:12:41,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:41,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 798ff8c1b3bbc4233e45a904a372078b, disabling compactions & flushes 2023-07-19 10:12:41,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:41,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:41,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. after waiting 0 ms 2023-07-19 10:12:41,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:41,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:41,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69444aea8b637000b8d79f0903d25442, disabling compactions & flushes 2023-07-19 10:12:41,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:41,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:41,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. after waiting 0 ms 2023-07-19 10:12:41,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:41,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:41,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:41,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b. 2023-07-19 10:12:41,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:12:41,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 798ff8c1b3bbc4233e45a904a372078b: 2023-07-19 10:12:41,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:12:41,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442. 2023-07-19 10:12:41,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69444aea8b637000b8d79f0903d25442: 2023-07-19 10:12:41,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:41,296 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=798ff8c1b3bbc4233e45a904a372078b, regionState=CLOSED 2023-07-19 10:12:41,296 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761561296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761561296"}]},"ts":"1689761561296"} 2023-07-19 10:12:41,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:41,296 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=69444aea8b637000b8d79f0903d25442, regionState=CLOSED 2023-07-19 10:12:41,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689761561296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689761561296"}]},"ts":"1689761561296"} 2023-07-19 10:12:41,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 10:12:41,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 798ff8c1b3bbc4233e45a904a372078b, server=jenkins-hbase4.apache.org,36483,1689761420784 in 204 msec 2023-07-19 10:12:41,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 10:12:41,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=798ff8c1b3bbc4233e45a904a372078b, UNASSIGN in 219 msec 2023-07-19 10:12:41,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 69444aea8b637000b8d79f0903d25442, server=jenkins-hbase4.apache.org,41773,1689761420713 in 205 msec 2023-07-19 10:12:41,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-19 10:12:41,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69444aea8b637000b8d79f0903d25442, UNASSIGN in 224 msec 2023-07-19 10:12:41,316 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689761561316"}]},"ts":"1689761561316"} 2023-07-19 10:12:41,318 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 10:12:41,320 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 10:12:41,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 250 msec 2023-07-19 10:12:41,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 10:12:41,379 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 10:12:41,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,393 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41773] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,399 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,399 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,399 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,399 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 10:12:41,400 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 10:12:41,400 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,401 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:41,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 10:12:41,401 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:12:41,401 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:41,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 10:12:41,401 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:41,401 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 10:12:41,401 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,401 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 10:12:41,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 10:12:41,407 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:41,410 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/recovered.edits] 2023-07-19 10:12:41,411 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:41,415 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf, FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/recovered.edits] 2023-07-19 10:12:41,418 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf/6e035c646668410ebecfce7a063abef4 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/cf/6e035c646668410ebecfce7a063abef4 2023-07-19 10:12:41,422 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf/19649ddcc9ab4fc09584e514ad86f4a0 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/cf/19649ddcc9ab4fc09584e514ad86f4a0 2023-07-19 10:12:41,424 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b/recovered.edits/9.seqid 2023-07-19 10:12:41,425 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/798ff8c1b3bbc4233e45a904a372078b 2023-07-19 10:12:41,426 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/recovered.edits/9.seqid to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442/recovered.edits/9.seqid 2023-07-19 10:12:41,427 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69444aea8b637000b8d79f0903d25442 2023-07-19 10:12:41,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 10:12:41,428 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 10:12:41,428 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-19 10:12:41,434 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719de197a9584cb4381b12206a8a4fb9d26 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719de197a9584cb4381b12206a8a4fb9d26 2023-07-19 10:12:41,436 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307191216e9047d904cd4860fad0be38ba4c9 to hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307191216e9047d904cd4860fad0be38ba4c9 2023-07-19 10:12:41,436 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 10:12:41,439 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,449 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 10:12:41,451 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 10:12:41,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 10:12:41,453 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761561453"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:41,453 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689761561453"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:41,457 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 10:12:41,457 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 798ff8c1b3bbc4233e45a904a372078b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689761541855.798ff8c1b3bbc4233e45a904a372078b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 69444aea8b637000b8d79f0903d25442, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689761541855.69444aea8b637000b8d79f0903d25442.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 10:12:41,457 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 10:12:41,457 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689761561457"}]},"ts":"9223372036854775807"} 2023-07-19 10:12:41,476 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 10:12:41,478 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 98 msec 2023-07-19 10:12:41,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 10:12:41,504 INFO [Listener at jenkins-hbase4.apache.org/43315] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 10:12:41,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 10:12:41,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 10:12:41,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38127] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 10:12:41,558 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-445455887_1 at /127.0.0.1:43970 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-48 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:56056 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (628091012) connection to jenkins-hbase4.apache.org/172.31.14.131:33491 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-445455887_1 at /127.0.0.1:58852 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740693978_17 at /127.0.0.1:56710 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6241c47d-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5434 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 903), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=499 (was 608), ProcessCount=181 (was 184), AvailableMemoryMB=1817 (was 1713) - AvailableMemoryMB LEAK? - 2023-07-19 10:12:41,558 WARN [Listener at jenkins-hbase4.apache.org/43315] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 10:12:41,558 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 10:12:41,597 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:12:41,734 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689761429945_0007_01_000001 is : 143 2023-07-19 10:12:46,872 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 10:12:55,732 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:13:09,856 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 10:13:09,857 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:13:09,870 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 10:13:09,885 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 10:13:09,887 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 10:13:09,924 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 10:13:10,029 ERROR [Thread[Thread-382,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 10:13:10,029 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 10:13:10,029 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 10:13:10,029 INFO [Listener at jenkins-hbase4.apache.org/43315] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 10:13:10,029 DEBUG [Listener at jenkins-hbase4.apache.org/43315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5356fd15 to 127.0.0.1:54485 2023-07-19 10:13:10,029 DEBUG [Listener at jenkins-hbase4.apache.org/43315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,030 DEBUG [Listener at jenkins-hbase4.apache.org/43315] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 10:13:10,030 DEBUG [Listener at jenkins-hbase4.apache.org/43315] util.JVMClusterUtil(257): Found active master hash=1618866687, stopped=false 2023-07-19 10:13:10,030 DEBUG [Listener at jenkins-hbase4.apache.org/43315] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,030 DEBUG [Listener at jenkins-hbase4.apache.org/43315] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 10:13:10,030 INFO [Listener at jenkins-hbase4.apache.org/43315] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:13:10,085 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:10,085 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:10,085 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:13:10,085 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:10,085 INFO [Listener at jenkins-hbase4.apache.org/43315] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 10:13:10,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:10,085 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 10:13:10,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:10,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:10,086 DEBUG [Listener at jenkins-hbase4.apache.org/43315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x626a2b36 to 127.0.0.1:54485 2023-07-19 10:13:10,087 DEBUG [Listener at jenkins-hbase4.apache.org/43315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,087 INFO [Listener at jenkins-hbase4.apache.org/43315] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41773,1689761420713' ***** 2023-07-19 10:13:10,087 DEBUG [Listener at jenkins-hbase4.apache.org/43315] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,087 INFO [Listener at jenkins-hbase4.apache.org/43315] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 10:13:10,087 INFO [Listener at jenkins-hbase4.apache.org/43315] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36483,1689761420784' ***** 2023-07-19 10:13:10,088 INFO [RS:0;jenkins-hbase4:41773] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 10:13:10,088 INFO [RS:0;jenkins-hbase4:41773] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 10:13:10,088 INFO [RS:0;jenkins-hbase4:41773] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 10:13:10,088 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(3305): Received CLOSE for fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:13:10,089 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(3305): Received CLOSE for 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:13:10,089 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:13:10,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd90fef8cb70bd655d900a49dad7d7e6, disabling compactions & flushes 2023-07-19 10:13:10,090 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 10:13:10,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:13:10,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 10:13:10,090 DEBUG [RS:0;jenkins-hbase4:41773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5edf2809 to 127.0.0.1:54485 2023-07-19 10:13:10,088 DEBUG [Listener at jenkins-hbase4.apache.org/43315] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,090 DEBUG [RS:0;jenkins-hbase4:41773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:13:10,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. after waiting 0 ms 2023-07-19 10:13:10,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:13:10,091 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 10:13:10,091 INFO [Listener at jenkins-hbase4.apache.org/43315] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 10:13:10,092 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1478): Online Regions={fd90fef8cb70bd655d900a49dad7d7e6=hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6., 17c19d636c7e5ca20c5d489740ed661c=hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c.} 2023-07-19 10:13:10,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fd90fef8cb70bd655d900a49dad7d7e6 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 10:13:10,092 INFO [RS:1;jenkins-hbase4:36483] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 10:13:10,092 INFO [RS:1;jenkins-hbase4:36483] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 10:13:10,092 INFO [RS:1;jenkins-hbase4:36483] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 10:13:10,092 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:13:10,092 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03b1a199 to 127.0.0.1:54485 2023-07-19 10:13:10,092 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,092 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 10:13:10,092 INFO [Listener at jenkins-hbase4.apache.org/43315] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43767,1689761420847' ***** 2023-07-19 10:13:10,095 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1504): Waiting on 17c19d636c7e5ca20c5d489740ed661c, fd90fef8cb70bd655d900a49dad7d7e6 2023-07-19 10:13:10,095 DEBUG [Listener at jenkins-hbase4.apache.org/43315] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,096 INFO [Listener at jenkins-hbase4.apache.org/43315] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 10:13:10,096 INFO [RS:2;jenkins-hbase4:43767] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 10:13:10,096 INFO [RS:2;jenkins-hbase4:43767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 10:13:10,096 INFO [RS:2;jenkins-hbase4:43767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 10:13:10,096 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:13:10,097 DEBUG [RS:2;jenkins-hbase4:43767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e33bcb9 to 127.0.0.1:54485 2023-07-19 10:13:10,097 DEBUG [RS:2;jenkins-hbase4:43767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,097 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 10:13:10,098 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36483,1689761420784; all regions closed. 2023-07-19 10:13:10,098 INFO [RS:2;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 10:13:10,099 INFO [RS:2;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 10:13:10,099 INFO [RS:2;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 10:13:10,099 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 10:13:10,100 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 10:13:10,100 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-19 10:13:10,100 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 10:13:10,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 10:13:10,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 10:13:10,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 10:13:10,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 10:13:10,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 10:13:10,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 10:13:10,123 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,130 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,131 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,160 DEBUG [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs 2023-07-19 10:13:10,160 INFO [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36483%2C1689761420784:(num 1689761423095) 2023-07-19 10:13:10,160 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,160 INFO [RS:1;jenkins-hbase4:36483] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,173 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 10:13:10,173 INFO [RS:1;jenkins-hbase4:36483] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 10:13:10,173 INFO [RS:1;jenkins-hbase4:36483] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 10:13:10,173 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:10,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/.tmp/info/61a01c914a44486487602f59346ab1c5 2023-07-19 10:13:10,174 INFO [RS:1;jenkins-hbase4:36483] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 10:13:10,176 INFO [RS:1;jenkins-hbase4:36483] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36483 2023-07-19 10:13:10,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/.tmp/info/95b4f50df0104eb38b306295c723ad69 2023-07-19 10:13:10,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/.tmp/info/61a01c914a44486487602f59346ab1c5 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/info/61a01c914a44486487602f59346ab1c5 2023-07-19 10:13:10,193 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95b4f50df0104eb38b306295c723ad69 2023-07-19 10:13:10,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/info/61a01c914a44486487602f59346ab1c5, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 10:13:10,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fd90fef8cb70bd655d900a49dad7d7e6 in 108ms, sequenceid=6, compaction requested=false 2023-07-19 10:13:10,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/namespace/fd90fef8cb70bd655d900a49dad7d7e6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 10:13:10,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:13:10,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd90fef8cb70bd655d900a49dad7d7e6: 2023-07-19 10:13:10,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689761423734.fd90fef8cb70bd655d900a49dad7d7e6. 2023-07-19 10:13:10,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/.tmp/rep_barrier/e13a91c0dd8547dc99fec5c29efd5f75 2023-07-19 10:13:10,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17c19d636c7e5ca20c5d489740ed661c, disabling compactions & flushes 2023-07-19 10:13:10,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:13:10,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:13:10,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. after waiting 0 ms 2023-07-19 10:13:10,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:13:10,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 17c19d636c7e5ca20c5d489740ed661c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 10:13:10,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e13a91c0dd8547dc99fec5c29efd5f75 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36483,1689761420784 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,233 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,234 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36483,1689761420784] 2023-07-19 10:13:10,235 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36483,1689761420784; numProcessing=1 2023-07-19 10:13:10,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/.tmp/l/2f0615e3399945f7974f237a54d68fe5 2023-07-19 10:13:10,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/.tmp/table/a72f6abab1d645968609e0603922d266 2023-07-19 10:13:10,262 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a72f6abab1d645968609e0603922d266 2023-07-19 10:13:10,264 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/.tmp/info/95b4f50df0104eb38b306295c723ad69 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/info/95b4f50df0104eb38b306295c723ad69 2023-07-19 10:13:10,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f0615e3399945f7974f237a54d68fe5 2023-07-19 10:13:10,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/.tmp/l/2f0615e3399945f7974f237a54d68fe5 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/l/2f0615e3399945f7974f237a54d68fe5 2023-07-19 10:13:10,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95b4f50df0104eb38b306295c723ad69 2023-07-19 10:13:10,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/info/95b4f50df0104eb38b306295c723ad69, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 10:13:10,274 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/.tmp/rep_barrier/e13a91c0dd8547dc99fec5c29efd5f75 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/rep_barrier/e13a91c0dd8547dc99fec5c29efd5f75 2023-07-19 10:13:10,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f0615e3399945f7974f237a54d68fe5 2023-07-19 10:13:10,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/l/2f0615e3399945f7974f237a54d68fe5, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 10:13:10,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 17c19d636c7e5ca20c5d489740ed661c in 61ms, sequenceid=18, compaction requested=false 2023-07-19 10:13:10,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e13a91c0dd8547dc99fec5c29efd5f75 2023-07-19 10:13:10,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/rep_barrier/e13a91c0dd8547dc99fec5c29efd5f75, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 10:13:10,286 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/.tmp/table/a72f6abab1d645968609e0603922d266 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/table/a72f6abab1d645968609e0603922d266 2023-07-19 10:13:10,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a72f6abab1d645968609e0603922d266 2023-07-19 10:13:10,298 DEBUG [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1504): Waiting on 17c19d636c7e5ca20c5d489740ed661c 2023-07-19 10:13:10,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/table/a72f6abab1d645968609e0603922d266, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 10:13:10,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 196ms, sequenceid=131, compaction requested=false 2023-07-19 10:13:10,300 DEBUG [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 10:13:10,308 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36483,1689761420784 already deleted, retry=false 2023-07-19 10:13:10,309 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36483,1689761420784 expired; onlineServers=2 2023-07-19 10:13:10,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/acl/17c19d636c7e5ca20c5d489740ed661c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 10:13:10,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:13:10,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17c19d636c7e5ca20c5d489740ed661c: 2023-07-19 10:13:10,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689761424501.17c19d636c7e5ca20c5d489740ed661c. 2023-07-19 10:13:10,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 10:13:10,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 10:13:10,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 10:13:10,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 10:13:10,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 10:13:10,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 10:13:10,378 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,378 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36483,1689761420784; zookeeper connection closed. 2023-07-19 10:13:10,378 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x1017d0f8e5b0002, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,378 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@16029dbc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@16029dbc 2023-07-19 10:13:10,498 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41773,1689761420713; all regions closed. 2023-07-19 10:13:10,500 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43767,1689761420847; all regions closed. 2023-07-19 10:13:10,513 DEBUG [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs 2023-07-19 10:13:10,513 DEBUG [RS:0;jenkins-hbase4:41773] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs 2023-07-19 10:13:10,513 INFO [RS:0;jenkins-hbase4:41773] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41773%2C1689761420713:(num 1689761423077) 2023-07-19 10:13:10,513 INFO [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1689761420847.meta:.meta(num 1689761423331) 2023-07-19 10:13:10,513 DEBUG [RS:0;jenkins-hbase4:41773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,513 INFO [RS:0;jenkins-hbase4:41773] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,523 INFO [RS:0;jenkins-hbase4:41773] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 10:13:10,524 INFO [RS:0;jenkins-hbase4:41773] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 10:13:10,524 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:10,524 INFO [RS:0;jenkins-hbase4:41773] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 10:13:10,524 INFO [RS:0;jenkins-hbase4:41773] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 10:13:10,525 INFO [RS:0;jenkins-hbase4:41773] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41773 2023-07-19 10:13:10,527 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:13:10,527 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,527 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41773,1689761420713 2023-07-19 10:13:10,530 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41773,1689761420713] 2023-07-19 10:13:10,530 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41773,1689761420713; numProcessing=2 2023-07-19 10:13:10,532 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41773,1689761420713 already deleted, retry=false 2023-07-19 10:13:10,532 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41773,1689761420713 expired; onlineServers=1 2023-07-19 10:13:10,534 DEBUG [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/oldWALs 2023-07-19 10:13:10,534 INFO [RS:2;jenkins-hbase4:43767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1689761420847:(num 1689761423051) 2023-07-19 10:13:10,534 DEBUG [RS:2;jenkins-hbase4:43767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,534 INFO [RS:2;jenkins-hbase4:43767] regionserver.LeaseManager(133): Closed leases 2023-07-19 10:13:10,534 INFO [RS:2;jenkins-hbase4:43767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 10:13:10,535 INFO [RS:2;jenkins-hbase4:43767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43767 2023-07-19 10:13:10,535 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:10,631 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,631 INFO [RS:0;jenkins-hbase4:41773] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41773,1689761420713; zookeeper connection closed. 2023-07-19 10:13:10,631 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:41773-0x1017d0f8e5b0001, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,634 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43767,1689761420847 2023-07-19 10:13:10,634 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 10:13:10,635 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@256f5bf5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@256f5bf5 2023-07-19 10:13:10,635 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43767,1689761420847] 2023-07-19 10:13:10,635 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43767,1689761420847; numProcessing=3 2023-07-19 10:13:10,638 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43767,1689761420847 already deleted, retry=false 2023-07-19 10:13:10,638 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43767,1689761420847 expired; onlineServers=0 2023-07-19 10:13:10,638 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38127,1689761419092' ***** 2023-07-19 10:13:10,638 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 10:13:10,638 DEBUG [M:0;jenkins-hbase4:38127] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2140fbc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 10:13:10,638 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38127,1689761419092 2023-07-19 10:13:10,638 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38127,1689761419092; all regions closed. 2023-07-19 10:13:10,638 DEBUG [M:0;jenkins-hbase4:38127] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 10:13:10,639 DEBUG [M:0;jenkins-hbase4:38127] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 10:13:10,639 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 10:13:10,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689761422576] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689761422576,5,FailOnTimeoutGroup] 2023-07-19 10:13:10,639 DEBUG [M:0;jenkins-hbase4:38127] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 10:13:10,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689761422542] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689761422542,5,FailOnTimeoutGroup] 2023-07-19 10:13:10,639 INFO [M:0;jenkins-hbase4:38127] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 10:13:10,639 INFO [M:0;jenkins-hbase4:38127] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 10:13:10,640 INFO [M:0;jenkins-hbase4:38127] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 10:13:10,640 DEBUG [M:0;jenkins-hbase4:38127] master.HMaster(1512): Stopping service threads 2023-07-19 10:13:10,640 INFO [M:0;jenkins-hbase4:38127] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 10:13:10,641 ERROR [M:0;jenkins-hbase4:38127] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 10:13:10,641 INFO [M:0;jenkins-hbase4:38127] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 10:13:10,641 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 10:13:10,643 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 10:13:10,643 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 10:13:10,643 DEBUG [M:0;jenkins-hbase4:38127] zookeeper.ZKUtil(398): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 10:13:10,643 WARN [M:0;jenkins-hbase4:38127] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 10:13:10,643 INFO [M:0;jenkins-hbase4:38127] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 10:13:10,643 INFO [M:0;jenkins-hbase4:38127] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 10:13:10,644 DEBUG [M:0;jenkins-hbase4:38127] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 10:13:10,644 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,644 DEBUG [M:0;jenkins-hbase4:38127] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,644 DEBUG [M:0;jenkins-hbase4:38127] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 10:13:10,645 DEBUG [M:0;jenkins-hbase4:38127] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,645 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.63 KB heapSize=451.88 KB 2023-07-19 10:13:10,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 10:13:10,680 INFO [M:0;jenkins-hbase4:38127] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.63 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c936c45994834479b7847ead77353ef0 2023-07-19 10:13:10,685 INFO [M:0;jenkins-hbase4:38127] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c936c45994834479b7847ead77353ef0 2023-07-19 10:13:10,686 DEBUG [M:0;jenkins-hbase4:38127] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c936c45994834479b7847ead77353ef0 as hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c936c45994834479b7847ead77353ef0 2023-07-19 10:13:10,692 INFO [M:0;jenkins-hbase4:38127] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c936c45994834479b7847ead77353ef0 2023-07-19 10:13:10,693 INFO [M:0;jenkins-hbase4:38127] regionserver.HStore(1080): Added hdfs://localhost:36553/user/jenkins/test-data/76ef5a85-9293-9377-60a6-06b139897bf9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c936c45994834479b7847ead77353ef0, entries=119, sequenceid=899, filesize=28.6 K 2023-07-19 10:13:10,694 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegion(2948): Finished flush of dataSize ~375.63 KB/384640, heapSize ~451.87 KB/462712, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 48ms, sequenceid=899, compaction requested=false 2023-07-19 10:13:10,696 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 10:13:10,696 DEBUG [M:0;jenkins-hbase4:38127] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 10:13:10,707 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 10:13:10,707 INFO [M:0;jenkins-hbase4:38127] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 10:13:10,708 INFO [M:0;jenkins-hbase4:38127] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38127 2023-07-19 10:13:10,711 DEBUG [M:0;jenkins-hbase4:38127] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38127,1689761419092 already deleted, retry=false 2023-07-19 10:13:10,737 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,737 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x1017d0f8e5b0003, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,737 INFO [RS:2;jenkins-hbase4:43767] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43767,1689761420847; zookeeper connection closed. 2023-07-19 10:13:10,738 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2dcee1e7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2dcee1e7 2023-07-19 10:13:10,738 INFO [Listener at jenkins-hbase4.apache.org/43315] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 10:13:10,838 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,838 DEBUG [Listener at localhost/34429-EventThread] zookeeper.ZKWatcher(600): master:38127-0x1017d0f8e5b0000, quorum=127.0.0.1:54485, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 10:13:10,838 INFO [M:0;jenkins-hbase4:38127] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38127,1689761419092; zookeeper connection closed. 2023-07-19 10:13:10,840 WARN [Listener at jenkins-hbase4.apache.org/43315] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 10:13:10,859 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,865 WARN [BP-327667721-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:36553] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 10:13:10,866 WARN [BP-327667721-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:36553] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-327667721-172.31.14.131-1689761414590 (Datanode Uuid 730bd243-de7a-49b0-a25b-edd40410df63) service to localhost/127.0.0.1:36553 2023-07-19 10:13:10,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data5/current/BP-327667721-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data6/current/BP-327667721-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,876 WARN [Listener at jenkins-hbase4.apache.org/43315] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 10:13:10,891 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,897 WARN [BP-327667721-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:36553] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 10:13:10,897 WARN [BP-327667721-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:36553] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-327667721-172.31.14.131-1689761414590 (Datanode Uuid 4b42019a-24b4-45d2-b9dd-439499dcd76a) service to localhost/127.0.0.1:36553 2023-07-19 10:13:10,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data3/current/BP-327667721-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,898 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data4/current/BP-327667721-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,900 WARN [Listener at jenkins-hbase4.apache.org/43315] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 10:13:10,909 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:10,912 WARN [BP-327667721-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:36553] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 10:13:10,912 WARN [BP-327667721-172.31.14.131-1689761414590 heartbeating to localhost/127.0.0.1:36553] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-327667721-172.31.14.131-1689761414590 (Datanode Uuid 791f0142-ab43-497e-9c37-ed4892b3753c) service to localhost/127.0.0.1:36553 2023-07-19 10:13:10,913 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data1/current/BP-327667721-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,913 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7a4ce79c-3cb2-8eff-bc87-7c4d82f8224d/cluster_83edb70c-6754-04c1-50d6-fd4ad68ae0a7/dfs/data/data2/current/BP-327667721-172.31.14.131-1689761414590] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 10:13:10,944 INFO [Listener at jenkins-hbase4.apache.org/43315] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 10:13:11,087 INFO [Listener at jenkins-hbase4.apache.org/43315] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 10:13:11,187 INFO [Listener at jenkins-hbase4.apache.org/43315] hbase.HBaseTestingUtility(1293): Minicluster is down