2023-09-27 04:00:24,575 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-27 04:00:24,783 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f 2023-09-27 04:00:24,784 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-27 04:00:24,784 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-27 04:00:24,824 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-27 04:00:25,063 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-27 04:00:25,063 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad, deleteOnExit=true 2023-09-27 04:00:25,064 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-27 04:00:25,064 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/test.cache.data in system properties and HBase conf 2023-09-27 04:00:25,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 04:00:25,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop.log.dir in system properties and HBase conf 2023-09-27 04:00:25,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 04:00:25,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 04:00:25,066 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 04:00:25,368 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-27 04:00:25,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 04:00:25,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 04:00:25,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 04:00:25,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 04:00:25,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 04:00:25,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 04:00:25,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 04:00:25,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 04:00:25,378 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 04:00:25,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/nfs.dump.dir in system properties and HBase conf 2023-09-27 04:00:25,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir in system properties and HBase conf 2023-09-27 04:00:25,379 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 04:00:25,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 04:00:25,380 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-27 04:00:25,892 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 04:00:25,899 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 04:00:26,195 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-27 04:00:26,377 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-27 04:00:26,393 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:26,447 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:26,496 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_localhost_35157_hdfs____hyltaz/webapp 2023-09-27 04:00:26,645 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35157 2023-09-27 04:00:26,706 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 04:00:26,706 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 04:00:27,157 WARN [Listener at localhost/39783] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 04:00:27,225 WARN [Listener at localhost/39783] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 04:00:27,246 WARN [Listener at localhost/39783] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:27,253 INFO [Listener at localhost/39783] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:27,260 INFO [Listener at localhost/39783] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_localhost_40591_datanode____.dbyah4/webapp 2023-09-27 04:00:27,386 INFO [Listener at localhost/39783] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40591 2023-09-27 04:00:27,870 WARN [Listener at localhost/41765] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 04:00:27,898 WARN [Listener at localhost/41765] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 04:00:27,905 WARN [Listener at localhost/41765] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:27,907 INFO [Listener at localhost/41765] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:27,918 INFO [Listener at localhost/41765] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_localhost_43339_datanode____.65btwf/webapp 2023-09-27 04:00:28,013 INFO [Listener at localhost/41765] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43339 2023-09-27 04:00:28,022 WARN [Listener at localhost/41703] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 04:00:28,049 WARN [Listener at localhost/41703] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 04:00:28,053 WARN [Listener at localhost/41703] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:28,055 INFO [Listener at localhost/41703] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:28,064 INFO [Listener at localhost/41703] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_localhost_43129_datanode____ndnyrk/webapp 2023-09-27 04:00:28,174 INFO [Listener at localhost/41703] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43129 2023-09-27 04:00:28,185 WARN [Listener at localhost/39473] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 04:00:28,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x165b21ddc2ff699a: Processing first storage report for DS-d7efe9d7-4887-4286-95de-7608607c9b62 from datanode b33c1893-1148-4ae1-8695-7d5215cd2c92 2023-09-27 04:00:28,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x165b21ddc2ff699a: from storage DS-d7efe9d7-4887-4286-95de-7608607c9b62 node DatanodeRegistration(127.0.0.1:34057, datanodeUuid=b33c1893-1148-4ae1-8695-7d5215cd2c92, infoPort=33013, infoSecurePort=0, ipcPort=39473, storageInfo=lv=-57;cid=testClusterID;nsid=293493021;c=1695787226001), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 04:00:28,439 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1766411f1c30637d: Processing first storage report for DS-499dbb31-8053-4771-939e-da8216ed38e2 from datanode ab105f4b-59eb-4b4d-80a0-f4b5d2ecaaef 2023-09-27 04:00:28,439 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1766411f1c30637d: from storage DS-499dbb31-8053-4771-939e-da8216ed38e2 node DatanodeRegistration(127.0.0.1:35641, datanodeUuid=ab105f4b-59eb-4b4d-80a0-f4b5d2ecaaef, infoPort=37389, infoSecurePort=0, ipcPort=41703, storageInfo=lv=-57;cid=testClusterID;nsid=293493021;c=1695787226001), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 04:00:28,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bb132d9d5173e5c: Processing first storage report for DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5 from datanode 3da8c2f3-93e2-4caf-8a3d-bc9d006986a2 2023-09-27 04:00:28,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bb132d9d5173e5c: from storage DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5 node DatanodeRegistration(127.0.0.1:46649, datanodeUuid=3da8c2f3-93e2-4caf-8a3d-bc9d006986a2, infoPort=35763, infoSecurePort=0, ipcPort=41765, storageInfo=lv=-57;cid=testClusterID;nsid=293493021;c=1695787226001), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 04:00:28,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x165b21ddc2ff699a: Processing first storage report for DS-c428274e-70f7-4a5b-af30-1bf2ebfd3d4f from datanode b33c1893-1148-4ae1-8695-7d5215cd2c92 2023-09-27 04:00:28,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x165b21ddc2ff699a: from storage DS-c428274e-70f7-4a5b-af30-1bf2ebfd3d4f node DatanodeRegistration(127.0.0.1:34057, datanodeUuid=b33c1893-1148-4ae1-8695-7d5215cd2c92, infoPort=33013, infoSecurePort=0, ipcPort=39473, storageInfo=lv=-57;cid=testClusterID;nsid=293493021;c=1695787226001), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 04:00:28,441 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1766411f1c30637d: Processing first storage report for DS-b399b00b-ba7b-41c0-abcb-9a8838ec4f5e from datanode ab105f4b-59eb-4b4d-80a0-f4b5d2ecaaef 2023-09-27 04:00:28,441 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1766411f1c30637d: from storage DS-b399b00b-ba7b-41c0-abcb-9a8838ec4f5e node DatanodeRegistration(127.0.0.1:35641, datanodeUuid=ab105f4b-59eb-4b4d-80a0-f4b5d2ecaaef, infoPort=37389, infoSecurePort=0, ipcPort=41703, storageInfo=lv=-57;cid=testClusterID;nsid=293493021;c=1695787226001), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 04:00:28,441 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7bb132d9d5173e5c: Processing first storage report for DS-de4abdbe-0098-4bb1-a847-303647c80d4a from datanode 3da8c2f3-93e2-4caf-8a3d-bc9d006986a2 2023-09-27 04:00:28,441 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7bb132d9d5173e5c: from storage DS-de4abdbe-0098-4bb1-a847-303647c80d4a node DatanodeRegistration(127.0.0.1:46649, datanodeUuid=3da8c2f3-93e2-4caf-8a3d-bc9d006986a2, infoPort=35763, infoSecurePort=0, ipcPort=41765, storageInfo=lv=-57;cid=testClusterID;nsid=293493021;c=1695787226001), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 04:00:28,680 DEBUG [Listener at localhost/39473] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f 2023-09-27 04:00:28,776 INFO [Listener at localhost/39473] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/zookeeper_0, clientPort=51909, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-27 04:00:28,798 INFO [Listener at localhost/39473] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51909 2023-09-27 04:00:28,808 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:28,811 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:29,487 INFO [Listener at localhost/39473] util.FSUtils(471): Created version file at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 with version=8 2023-09-27 04:00:29,487 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/hbase-staging 2023-09-27 04:00:29,806 INFO [Listener at localhost/39473] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-27 04:00:30,216 INFO [Listener at localhost/39473] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-09-27 04:00:30,243 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,243 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,243 INFO [Listener at localhost/39473] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 04:00:30,243 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,244 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 04:00:30,384 INFO [Listener at localhost/39473] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 04:00:30,448 DEBUG [Listener at localhost/39473] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-27 04:00:30,528 INFO [Listener at localhost/39473] ipc.NettyRpcServer(120): Bind to /136.243.18.41:43371 2023-09-27 04:00:30,539 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,541 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,560 INFO [Listener at localhost/39473] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43371 connecting to ZooKeeper ensemble=127.0.0.1:51909 2023-09-27 04:00:30,618 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:433710x0, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 04:00:30,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43371-0x100eb89d9940000 connected 2023-09-27 04:00:30,650 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 04:00:30,651 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:00:30,665 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 04:00:30,672 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43371 2023-09-27 04:00:30,672 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43371 2023-09-27 04:00:30,673 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43371 2023-09-27 04:00:30,674 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43371 2023-09-27 04:00:30,674 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43371 2023-09-27 04:00:30,681 INFO [Listener at localhost/39473] master.HMaster(444): hbase.rootdir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, hbase.cluster.distributed=false 2023-09-27 04:00:30,748 INFO [Listener at localhost/39473] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-27 04:00:30,748 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,748 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,749 INFO [Listener at localhost/39473] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 04:00:30,749 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,749 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 04:00:30,753 INFO [Listener at localhost/39473] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 04:00:30,756 INFO [Listener at localhost/39473] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38525 2023-09-27 04:00:30,759 INFO [Listener at localhost/39473] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 04:00:30,766 INFO [Listener at localhost/39473] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 04:00:30,767 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,769 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,771 INFO [Listener at localhost/39473] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38525 connecting to ZooKeeper ensemble=127.0.0.1:51909 2023-09-27 04:00:30,775 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:385250x0, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 04:00:30,776 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:385250x0, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 04:00:30,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38525-0x100eb89d9940001 connected 2023-09-27 04:00:30,778 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:00:30,779 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 04:00:30,780 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38525 2023-09-27 04:00:30,780 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38525 2023-09-27 04:00:30,781 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38525 2023-09-27 04:00:30,785 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38525 2023-09-27 04:00:30,785 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38525 2023-09-27 04:00:30,796 INFO [Listener at localhost/39473] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-27 04:00:30,797 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,797 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,797 INFO [Listener at localhost/39473] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 04:00:30,798 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,798 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 04:00:30,798 INFO [Listener at localhost/39473] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 04:00:30,800 INFO [Listener at localhost/39473] ipc.NettyRpcServer(120): Bind to /136.243.18.41:36187 2023-09-27 04:00:30,800 INFO [Listener at localhost/39473] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 04:00:30,803 INFO [Listener at localhost/39473] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 04:00:30,804 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,808 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,812 INFO [Listener at localhost/39473] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36187 connecting to ZooKeeper ensemble=127.0.0.1:51909 2023-09-27 04:00:30,815 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:361870x0, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 04:00:30,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36187-0x100eb89d9940002 connected 2023-09-27 04:00:30,816 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 04:00:30,817 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:00:30,818 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 04:00:30,819 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36187 2023-09-27 04:00:30,821 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36187 2023-09-27 04:00:30,821 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36187 2023-09-27 04:00:30,822 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36187 2023-09-27 04:00:30,822 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36187 2023-09-27 04:00:30,833 INFO [Listener at localhost/39473] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-27 04:00:30,833 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,833 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,834 INFO [Listener at localhost/39473] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 04:00:30,834 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 04:00:30,834 INFO [Listener at localhost/39473] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 04:00:30,834 INFO [Listener at localhost/39473] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 04:00:30,836 INFO [Listener at localhost/39473] ipc.NettyRpcServer(120): Bind to /136.243.18.41:44775 2023-09-27 04:00:30,836 INFO [Listener at localhost/39473] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 04:00:30,837 INFO [Listener at localhost/39473] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 04:00:30,838 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,840 INFO [Listener at localhost/39473] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:30,843 INFO [Listener at localhost/39473] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44775 connecting to ZooKeeper ensemble=127.0.0.1:51909 2023-09-27 04:00:30,848 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:447750x0, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 04:00:30,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44775-0x100eb89d9940003 connected 2023-09-27 04:00:30,849 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 04:00:30,850 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:00:30,851 DEBUG [Listener at localhost/39473] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 04:00:30,853 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44775 2023-09-27 04:00:30,853 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44775 2023-09-27 04:00:30,853 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44775 2023-09-27 04:00:30,854 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44775 2023-09-27 04:00:30,854 DEBUG [Listener at localhost/39473] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44775 2023-09-27 04:00:30,856 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:30,864 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 04:00:30,866 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:30,885 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 04:00:30,885 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 04:00:30,885 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 04:00:30,885 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 04:00:30,886 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:30,888 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 04:00:30,889 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,43371,1695787229649 from backup master directory 2023-09-27 04:00:30,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 04:00:30,893 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:30,893 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 04:00:30,894 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 04:00:30,894 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:30,898 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-27 04:00:30,899 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-27 04:00:30,995 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/hbase.id with ID: f87d37da-7c11-421e-aba3-151d6de8d16c 2023-09-27 04:00:31,050 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 04:00:31,069 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:31,120 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x34c21bf9 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:31,170 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d81b597, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:31,209 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 04:00:31,212 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-27 04:00:31,238 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-27 04:00:31,238 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-27 04:00:31,242 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 04:00:31,248 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 04:00:31,250 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 04:00:31,292 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store-tmp 2023-09-27 04:00:31,356 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:31,356 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 04:00:31,356 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:00:31,356 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:00:31,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 04:00:31,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:00:31,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:00:31,357 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 04:00:31,359 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/WALs/jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:31,386 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C43371%2C1695787229649, suffix=, logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/WALs/jenkins-hbase17.apache.org,43371,1695787229649, archiveDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/oldWALs, maxLogs=10 2023-09-27 04:00:31,452 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK] 2023-09-27 04:00:31,452 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK] 2023-09-27 04:00:31,452 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK] 2023-09-27 04:00:31,462 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-27 04:00:31,531 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/WALs/jenkins-hbase17.apache.org,43371,1695787229649/jenkins-hbase17.apache.org%2C43371%2C1695787229649.1695787231398 2023-09-27 04:00:31,531 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK], DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK], DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK]] 2023-09-27 04:00:31,531 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-27 04:00:31,532 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:31,536 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 04:00:31,538 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 04:00:31,603 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-27 04:00:31,610 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-27 04:00:31,634 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-27 04:00:31,647 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:31,653 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 04:00:31,655 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 04:00:31,673 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 04:00:31,677 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:00:31,678 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73680778, jitterRate=0.09792914986610413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:00:31,678 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 04:00:31,680 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-27 04:00:31,700 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-27 04:00:31,701 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-27 04:00:31,703 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-27 04:00:31,705 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-27 04:00:31,736 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 30 msec 2023-09-27 04:00:31,736 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-27 04:00:31,766 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-27 04:00:31,772 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-27 04:00:31,797 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-27 04:00:31,802 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-27 04:00:31,803 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-27 04:00:31,806 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-27 04:00:31,809 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-27 04:00:31,813 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-27 04:00:31,816 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:31,817 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-27 04:00:31,818 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-27 04:00:31,833 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-27 04:00:31,838 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 04:00:31,838 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 04:00:31,838 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 04:00:31,838 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:31,838 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 04:00:31,840 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,43371,1695787229649, sessionid=0x100eb89d9940000, setting cluster-up flag (Was=false) 2023-09-27 04:00:31,859 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:31,863 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-27 04:00:31,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:31,869 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:31,873 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-27 04:00:31,874 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:31,877 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp 2023-09-27 04:00:31,949 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-27 04:00:31,953 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:31,954 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-27 04:00:31,958 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(951): ClusterId : f87d37da-7c11-421e-aba3-151d6de8d16c 2023-09-27 04:00:31,958 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(951): ClusterId : f87d37da-7c11-421e-aba3-151d6de8d16c 2023-09-27 04:00:31,959 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(951): ClusterId : f87d37da-7c11-421e-aba3-151d6de8d16c 2023-09-27 04:00:31,965 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 04:00:31,965 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 04:00:31,965 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 04:00:31,971 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 04:00:31,971 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 04:00:31,971 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 04:00:31,972 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 04:00:31,971 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 04:00:31,972 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 04:00:31,975 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 04:00:31,975 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 04:00:31,975 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 04:00:31,980 DEBUG [RS:2;jenkins-hbase17:44775] zookeeper.ReadOnlyZKClient(139): Connect 0x7bf5a3c6 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:31,980 DEBUG [RS:1;jenkins-hbase17:36187] zookeeper.ReadOnlyZKClient(139): Connect 0x4c47cadc to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:31,980 DEBUG [RS:0;jenkins-hbase17:38525] zookeeper.ReadOnlyZKClient(139): Connect 0x6a862769 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:31,990 DEBUG [RS:2;jenkins-hbase17:44775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@753242c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:31,991 DEBUG [RS:2;jenkins-hbase17:44775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@710dc8b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-27 04:00:32,043 DEBUG [RS:0;jenkins-hbase17:38525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6441d449, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:32,043 DEBUG [RS:1;jenkins-hbase17:36187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42802d24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:32,043 DEBUG [RS:0;jenkins-hbase17:38525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@607e4c19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-27 04:00:32,044 DEBUG [RS:1;jenkins-hbase17:36187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bd271f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-27 04:00:32,063 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:38525 2023-09-27 04:00:32,065 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:44775 2023-09-27 04:00:32,065 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:36187 2023-09-27 04:00:32,068 INFO [RS:0;jenkins-hbase17:38525] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 04:00:32,068 INFO [RS:1;jenkins-hbase17:36187] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 04:00:32,069 INFO [RS:1;jenkins-hbase17:36187] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 04:00:32,068 INFO [RS:2;jenkins-hbase17:44775] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 04:00:32,069 INFO [RS:2;jenkins-hbase17:44775] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 04:00:32,069 INFO [RS:0;jenkins-hbase17:38525] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 04:00:32,070 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 04:00:32,070 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 04:00:32,070 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 04:00:32,071 INFO [RS:0;jenkins-hbase17:38525] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:32,071 INFO [RS:1;jenkins-hbase17:36187] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:32,071 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 04:00:32,071 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 04:00:32,071 INFO [RS:2;jenkins-hbase17:44775] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:32,072 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 04:00:32,074 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,43371,1695787229649 with isa=jenkins-hbase17.apache.org/136.243.18.41:38525, startcode=1695787230747 2023-09-27 04:00:32,074 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,43371,1695787229649 with isa=jenkins-hbase17.apache.org/136.243.18.41:36187, startcode=1695787230796 2023-09-27 04:00:32,074 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,43371,1695787229649 with isa=jenkins-hbase17.apache.org/136.243.18.41:44775, startcode=1695787230832 2023-09-27 04:00:32,087 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-27 04:00:32,096 DEBUG [RS:1;jenkins-hbase17:36187] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 04:00:32,096 DEBUG [RS:2;jenkins-hbase17:44775] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 04:00:32,096 DEBUG [RS:0;jenkins-hbase17:38525] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 04:00:32,102 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-27 04:00:32,102 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-27 04:00:32,102 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-27 04:00:32,103 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-27 04:00:32,103 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-09-27 04:00:32,103 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,103 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-27 04:00:32,103 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,104 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695787262104 2023-09-27 04:00:32,107 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-27 04:00:32,113 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 04:00:32,115 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-27 04:00:32,120 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 04:00:32,125 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-27 04:00:32,133 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-27 04:00:32,134 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-27 04:00:32,134 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-27 04:00:32,134 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-27 04:00:32,138 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,140 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-27 04:00:32,144 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-27 04:00:32,144 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-27 04:00:32,149 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-27 04:00:32,150 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-27 04:00:32,152 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1695787232152,5,FailOnTimeoutGroup] 2023-09-27 04:00:32,152 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1695787232152,5,FailOnTimeoutGroup] 2023-09-27 04:00:32,152 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,152 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-27 04:00:32,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,155 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,165 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54441, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 04:00:32,165 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42785, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 04:00:32,165 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42825, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 04:00:32,190 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 04:00:32,191 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43371] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,192 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 04:00:32,192 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:00:32,207 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43371] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,208 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43371] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,218 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:00:32,219 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:00:32,219 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:00:32,219 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39783 2023-09-27 04:00:32,219 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39783 2023-09-27 04:00:32,219 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 04:00:32,219 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 04:00:32,219 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39783 2023-09-27 04:00:32,220 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 04:00:32,224 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:32,227 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 04:00:32,228 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 04:00:32,228 DEBUG [RS:1;jenkins-hbase17:36187] zookeeper.ZKUtil(162): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,228 WARN [RS:1;jenkins-hbase17:36187] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 04:00:32,228 DEBUG [RS:2;jenkins-hbase17:44775] zookeeper.ZKUtil(162): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,228 INFO [RS:1;jenkins-hbase17:36187] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 04:00:32,229 DEBUG [RS:0;jenkins-hbase17:38525] zookeeper.ZKUtil(162): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,228 WARN [RS:2;jenkins-hbase17:44775] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 04:00:32,230 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,230 WARN [RS:0;jenkins-hbase17:38525] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 04:00:32,230 INFO [RS:2;jenkins-hbase17:44775] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 04:00:32,230 INFO [RS:0;jenkins-hbase17:38525] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 04:00:32,230 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,231 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,231 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,44775,1695787230832] 2023-09-27 04:00:32,231 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,38525,1695787230747] 2023-09-27 04:00:32,231 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,36187,1695787230796] 2023-09-27 04:00:32,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/info 2023-09-27 04:00:32,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 04:00:32,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:32,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 04:00:32,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/rep_barrier 2023-09-27 04:00:32,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 04:00:32,246 DEBUG [RS:0;jenkins-hbase17:38525] zookeeper.ZKUtil(162): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,246 DEBUG [RS:2;jenkins-hbase17:44775] zookeeper.ZKUtil(162): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,246 DEBUG [RS:1;jenkins-hbase17:36187] zookeeper.ZKUtil(162): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,248 DEBUG [RS:0;jenkins-hbase17:38525] zookeeper.ZKUtil(162): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,248 DEBUG [RS:2;jenkins-hbase17:44775] zookeeper.ZKUtil(162): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,248 DEBUG [RS:1;jenkins-hbase17:36187] zookeeper.ZKUtil(162): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:32,248 DEBUG [RS:0;jenkins-hbase17:38525] zookeeper.ZKUtil(162): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,248 DEBUG [RS:2;jenkins-hbase17:44775] zookeeper.ZKUtil(162): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 04:00:32,249 DEBUG [RS:1;jenkins-hbase17:36187] zookeeper.ZKUtil(162): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,251 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/table 2023-09-27 04:00:32,252 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 04:00:32,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:32,255 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740 2023-09-27 04:00:32,257 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740 2023-09-27 04:00:32,262 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 04:00:32,263 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 04:00:32,262 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 04:00:32,263 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 04:00:32,266 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 04:00:32,274 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:00:32,275 INFO [RS:1;jenkins-hbase17:36187] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 04:00:32,275 INFO [RS:2;jenkins-hbase17:44775] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 04:00:32,275 INFO [RS:0;jenkins-hbase17:38525] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 04:00:32,276 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68654371, jitterRate=0.02302984893321991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 04:00:32,276 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 04:00:32,276 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 04:00:32,276 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 04:00:32,276 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 04:00:32,277 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 04:00:32,277 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 04:00:32,278 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 04:00:32,278 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 04:00:32,285 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 04:00:32,285 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-27 04:00:32,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-27 04:00:32,304 INFO [RS:2;jenkins-hbase17:44775] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 04:00:32,305 INFO [RS:0;jenkins-hbase17:38525] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 04:00:32,306 INFO [RS:1;jenkins-hbase17:36187] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 04:00:32,309 INFO [RS:0;jenkins-hbase17:38525] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 04:00:32,309 INFO [RS:2;jenkins-hbase17:44775] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 04:00:32,309 INFO [RS:1;jenkins-hbase17:36187] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 04:00:32,311 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,310 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,311 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,312 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 04:00:32,312 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 04:00:32,312 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 04:00:32,317 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-27 04:00:32,320 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-27 04:00:32,323 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,323 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,323 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,323 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,323 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,323 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-27 04:00:32,326 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-27 04:00:32,326 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,326 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:2;jenkins-hbase17:44775] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,327 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-27 04:00:32,327 DEBUG [RS:1;jenkins-hbase17:36187] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,328 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,329 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,329 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,329 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,329 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,329 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,329 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,329 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,329 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,329 DEBUG [RS:0;jenkins-hbase17:38525] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-27 04:00:32,333 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,333 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,333 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,348 INFO [RS:0;jenkins-hbase17:38525] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 04:00:32,348 INFO [RS:2;jenkins-hbase17:44775] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 04:00:32,348 INFO [RS:1;jenkins-hbase17:36187] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 04:00:32,353 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38525,1695787230747-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,353 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36187,1695787230796-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,353 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,44775,1695787230832-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,371 INFO [RS:0;jenkins-hbase17:38525] regionserver.Replication(203): jenkins-hbase17.apache.org,38525,1695787230747 started 2023-09-27 04:00:32,371 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,38525,1695787230747, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:38525, sessionid=0x100eb89d9940001 2023-09-27 04:00:32,372 INFO [RS:2;jenkins-hbase17:44775] regionserver.Replication(203): jenkins-hbase17.apache.org,44775,1695787230832 started 2023-09-27 04:00:32,372 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 04:00:32,372 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,44775,1695787230832, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:44775, sessionid=0x100eb89d9940003 2023-09-27 04:00:32,372 DEBUG [RS:0;jenkins-hbase17:38525] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,372 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 04:00:32,372 INFO [RS:1;jenkins-hbase17:36187] regionserver.Replication(203): jenkins-hbase17.apache.org,36187,1695787230796 started 2023-09-27 04:00:32,372 DEBUG [RS:2;jenkins-hbase17:44775] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,372 DEBUG [RS:0;jenkins-hbase17:38525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38525,1695787230747' 2023-09-27 04:00:32,373 DEBUG [RS:2;jenkins-hbase17:44775] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44775,1695787230832' 2023-09-27 04:00:32,373 DEBUG [RS:2;jenkins-hbase17:44775] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 04:00:32,373 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,36187,1695787230796, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:36187, sessionid=0x100eb89d9940002 2023-09-27 04:00:32,373 DEBUG [RS:0;jenkins-hbase17:38525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 04:00:32,373 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 04:00:32,374 DEBUG [RS:1;jenkins-hbase17:36187] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,374 DEBUG [RS:1;jenkins-hbase17:36187] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36187,1695787230796' 2023-09-27 04:00:32,374 DEBUG [RS:1;jenkins-hbase17:36187] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 04:00:32,374 DEBUG [RS:0;jenkins-hbase17:38525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 04:00:32,374 DEBUG [RS:2;jenkins-hbase17:44775] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 04:00:32,374 DEBUG [RS:1;jenkins-hbase17:36187] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 04:00:32,375 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 04:00:32,375 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 04:00:32,375 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 04:00:32,375 DEBUG [RS:0;jenkins-hbase17:38525] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:32,375 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 04:00:32,375 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 04:00:32,375 DEBUG [RS:2;jenkins-hbase17:44775] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:32,375 DEBUG [RS:0;jenkins-hbase17:38525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38525,1695787230747' 2023-09-27 04:00:32,377 DEBUG [RS:2;jenkins-hbase17:44775] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,44775,1695787230832' 2023-09-27 04:00:32,376 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 04:00:32,377 DEBUG [RS:2;jenkins-hbase17:44775] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:32,377 DEBUG [RS:0;jenkins-hbase17:38525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:32,377 DEBUG [RS:1;jenkins-hbase17:36187] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,377 DEBUG [RS:1;jenkins-hbase17:36187] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36187,1695787230796' 2023-09-27 04:00:32,377 DEBUG [RS:1;jenkins-hbase17:36187] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:32,377 DEBUG [RS:2;jenkins-hbase17:44775] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:32,377 DEBUG [RS:0;jenkins-hbase17:38525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:32,377 DEBUG [RS:1;jenkins-hbase17:36187] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:32,378 DEBUG [RS:2;jenkins-hbase17:44775] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 04:00:32,378 INFO [RS:2;jenkins-hbase17:44775] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 04:00:32,378 DEBUG [RS:1;jenkins-hbase17:36187] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 04:00:32,378 INFO [RS:2;jenkins-hbase17:44775] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 04:00:32,378 DEBUG [RS:0;jenkins-hbase17:38525] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 04:00:32,378 INFO [RS:1;jenkins-hbase17:36187] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 04:00:32,378 INFO [RS:0;jenkins-hbase17:38525] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 04:00:32,378 INFO [RS:1;jenkins-hbase17:36187] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 04:00:32,378 INFO [RS:0;jenkins-hbase17:38525] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 04:00:32,472 DEBUG [jenkins-hbase17:43371] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-27 04:00:32,476 DEBUG [jenkins-hbase17:43371] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:00:32,481 DEBUG [jenkins-hbase17:43371] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:00:32,482 DEBUG [jenkins-hbase17:43371] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:00:32,482 DEBUG [jenkins-hbase17:43371] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:00:32,482 DEBUG [jenkins-hbase17:43371] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:00:32,485 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,36187,1695787230796, state=OPENING 2023-09-27 04:00:32,491 INFO [RS:2;jenkins-hbase17:44775] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C44775%2C1695787230832, suffix=, logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,44775,1695787230832, archiveDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs, maxLogs=32 2023-09-27 04:00:32,491 INFO [RS:0;jenkins-hbase17:38525] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38525%2C1695787230747, suffix=, logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,38525,1695787230747, archiveDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs, maxLogs=32 2023-09-27 04:00:32,491 INFO [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36187%2C1695787230796, suffix=, logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,36187,1695787230796, archiveDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs, maxLogs=32 2023-09-27 04:00:32,493 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-27 04:00:32,494 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:32,494 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 04:00:32,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:00:32,523 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK] 2023-09-27 04:00:32,524 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK] 2023-09-27 04:00:32,533 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK] 2023-09-27 04:00:32,537 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK] 2023-09-27 04:00:32,537 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK] 2023-09-27 04:00:32,540 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK] 2023-09-27 04:00:32,546 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK] 2023-09-27 04:00:32,546 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK] 2023-09-27 04:00:32,546 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK] 2023-09-27 04:00:32,560 INFO [RS:2;jenkins-hbase17:44775] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,44775,1695787230832/jenkins-hbase17.apache.org%2C44775%2C1695787230832.1695787232495 2023-09-27 04:00:32,560 INFO [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,36187,1695787230796/jenkins-hbase17.apache.org%2C36187%2C1695787230796.1695787232495 2023-09-27 04:00:32,561 INFO [RS:0;jenkins-hbase17:38525] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,38525,1695787230747/jenkins-hbase17.apache.org%2C38525%2C1695787230747.1695787232495 2023-09-27 04:00:32,561 DEBUG [RS:2;jenkins-hbase17:44775] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK], DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK], DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK]] 2023-09-27 04:00:32,561 DEBUG [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK], DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK], DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK]] 2023-09-27 04:00:32,561 DEBUG [RS:0;jenkins-hbase17:38525] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK], DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK], DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK]] 2023-09-27 04:00:32,694 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:32,698 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 04:00:32,702 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 04:00:32,718 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-27 04:00:32,719 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 04:00:32,724 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36187%2C1695787230796.meta, suffix=.meta, logDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,36187,1695787230796, archiveDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs, maxLogs=32 2023-09-27 04:00:32,747 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK] 2023-09-27 04:00:32,748 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK] 2023-09-27 04:00:32,749 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK] 2023-09-27 04:00:32,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/WALs/jenkins-hbase17.apache.org,36187,1695787230796/jenkins-hbase17.apache.org%2C36187%2C1695787230796.meta.1695787232725.meta 2023-09-27 04:00:32,755 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34057,DS-d7efe9d7-4887-4286-95de-7608607c9b62,DISK], DatanodeInfoWithStorage[127.0.0.1:35641,DS-499dbb31-8053-4771-939e-da8216ed38e2,DISK], DatanodeInfoWithStorage[127.0.0.1:46649,DS-caba3740-2996-4e75-b9bd-cbc65aa7d5c5,DISK]] 2023-09-27 04:00:32,755 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-27 04:00:32,756 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-27 04:00:32,758 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:32,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-27 04:00:32,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-27 04:00:32,763 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-27 04:00:32,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-27 04:00:32,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:32,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-27 04:00:32,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-27 04:00:32,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 04:00:32,781 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/info 2023-09-27 04:00:32,781 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/info 2023-09-27 04:00:32,781 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 04:00:32,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:32,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 04:00:32,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/rep_barrier 2023-09-27 04:00:32,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/rep_barrier 2023-09-27 04:00:32,787 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 04:00:32,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:32,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 04:00:32,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/table 2023-09-27 04:00:32,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/table 2023-09-27 04:00:32,792 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 04:00:32,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:32,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740 2023-09-27 04:00:32,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740 2023-09-27 04:00:32,802 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 04:00:32,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 04:00:32,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70751306, jitterRate=0.054276615381240845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 04:00:32,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 04:00:32,822 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695787232686 2023-09-27 04:00:32,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-27 04:00:32,846 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-27 04:00:32,847 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,36187,1695787230796, state=OPEN 2023-09-27 04:00:32,849 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-27 04:00:32,850 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 04:00:32,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-27 04:00:32,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,36187,1695787230796 in 351 msec 2023-09-27 04:00:32,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-27 04:00:32,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 558 msec 2023-09-27 04:00:32,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 904 msec 2023-09-27 04:00:32,867 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695787232867, completionTime=-1 2023-09-27 04:00:32,868 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-27 04:00:32,868 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-27 04:00:32,933 DEBUG [hconnection-0x198566fb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:32,937 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:32,962 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-27 04:00:32,962 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695787292962 2023-09-27 04:00:32,962 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695787352962 2023-09-27 04:00:32,962 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 94 msec 2023-09-27 04:00:32,986 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43371,1695787229649-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,986 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43371,1695787229649-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,986 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43371,1695787229649-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,988 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:43371, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:32,989 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-27 04:00:33,002 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-27 04:00:33,009 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-27 04:00:33,011 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 04:00:33,021 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-27 04:00:33,023 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:00:33,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:00:33,052 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,057 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4 empty. 2023-09-27 04:00:33,058 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-27 04:00:33,108 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-27 04:00:33,118 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => db5d6a40ff4cdcd2b3037d9b242589c4, NAME => 'hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:00:33,142 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing db5d6a40ff4cdcd2b3037d9b242589c4, disabling compactions & flushes 2023-09-27 04:00:33,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. after waiting 0 ms 2023-09-27 04:00:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for db5d6a40ff4cdcd2b3037d9b242589c4: 2023-09-27 04:00:33,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:00:33,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695787233152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787233152"}]},"ts":"1695787233152"} 2023-09-27 04:00:33,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 04:00:33,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:00:33,202 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787233198"}]},"ts":"1695787233198"} 2023-09-27 04:00:33,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-27 04:00:33,246 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:00:33,247 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:00:33,247 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:00:33,247 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:00:33,247 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:00:33,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=db5d6a40ff4cdcd2b3037d9b242589c4, ASSIGN}] 2023-09-27 04:00:33,254 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=db5d6a40ff4cdcd2b3037d9b242589c4, ASSIGN 2023-09-27 04:00:33,256 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=db5d6a40ff4cdcd2b3037d9b242589c4, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:00:33,408 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 04:00:33,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=db5d6a40ff4cdcd2b3037d9b242589c4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:33,410 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695787233409"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787233409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787233409"}]},"ts":"1695787233409"} 2023-09-27 04:00:33,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure db5d6a40ff4cdcd2b3037d9b242589c4, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:00:33,571 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:33,571 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 04:00:33,574 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 04:00:33,581 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db5d6a40ff4cdcd2b3037d9b242589c4, NAME => 'hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.', STARTKEY => '', ENDKEY => ''} 2023-09-27 04:00:33,582 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. service=AccessControlService 2023-09-27 04:00:33,583 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:33,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:33,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,587 INFO [StoreOpener-db5d6a40ff4cdcd2b3037d9b242589c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,590 DEBUG [StoreOpener-db5d6a40ff4cdcd2b3037d9b242589c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/info 2023-09-27 04:00:33,590 DEBUG [StoreOpener-db5d6a40ff4cdcd2b3037d9b242589c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/info 2023-09-27 04:00:33,590 INFO [StoreOpener-db5d6a40ff4cdcd2b3037d9b242589c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db5d6a40ff4cdcd2b3037d9b242589c4 columnFamilyName info 2023-09-27 04:00:33,591 INFO [StoreOpener-db5d6a40ff4cdcd2b3037d9b242589c4-1] regionserver.HStore(310): Store=db5d6a40ff4cdcd2b3037d9b242589c4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:33,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:00:33,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:00:33,604 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened db5d6a40ff4cdcd2b3037d9b242589c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74379749, jitterRate=0.10834462940692902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:00:33,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for db5d6a40ff4cdcd2b3037d9b242589c4: 2023-09-27 04:00:33,609 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4., pid=6, masterSystemTime=1695787233571 2023-09-27 04:00:33,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,615 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:00:33,617 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=db5d6a40ff4cdcd2b3037d9b242589c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:33,617 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695787233616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787233616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787233616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787233616"}]},"ts":"1695787233616"} 2023-09-27 04:00:33,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-27 04:00:33,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure db5d6a40ff4cdcd2b3037d9b242589c4, server=jenkins-hbase17.apache.org,38525,1695787230747 in 205 msec 2023-09-27 04:00:33,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-27 04:00:33,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=db5d6a40ff4cdcd2b3037d9b242589c4, ASSIGN in 376 msec 2023-09-27 04:00:33,635 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:00:33,636 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787233635"}]},"ts":"1695787233635"} 2023-09-27 04:00:33,639 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-27 04:00:33,642 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:00:33,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 630 msec 2023-09-27 04:00:33,737 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-27 04:00:33,738 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-27 04:00:33,738 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:33,760 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:33,764 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:33,777 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-27 04:00:33,794 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 04:00:33,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-09-27 04:00:33,810 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-27 04:00:33,823 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 04:00:33,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-27 04:00:33,836 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-27 04:00:33,838 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-27 04:00:33,838 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.943sec 2023-09-27 04:00:33,841 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-27 04:00:33,843 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-27 04:00:33,843 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-27 04:00:33,844 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43371,1695787229649-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-27 04:00:33,845 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43371,1695787229649-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-27 04:00:33,865 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 04:00:33,867 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-27 04:00:33,868 DEBUG [Listener at localhost/39473] zookeeper.ReadOnlyZKClient(139): Connect 0x551d4abf to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:33,870 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:00:33,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:00:33,874 DEBUG [Listener at localhost/39473] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a9ced3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:33,875 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-27 04:00:33,876 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:33,878 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729 empty. 2023-09-27 04:00:33,881 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:33,881 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-27 04:00:33,886 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 04:00:33,895 DEBUG [hconnection-0x749062ba-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:33,913 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-27 04:00:33,915 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e68891c228a7144b5752f01c0ef2f729, NAME => 'hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:00:33,917 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:33,920 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:00:33,927 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-27 04:00:33,927 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/test.cache.data in system properties and HBase conf 2023-09-27 04:00:33,927 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 04:00:33,927 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop.log.dir in system properties and HBase conf 2023-09-27 04:00:33,927 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 04:00:33,928 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/nfs.dump.dir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 04:00:33,929 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 04:00:33,930 INFO [Listener at localhost/39473] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-27 04:00:33,947 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:33,947 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e68891c228a7144b5752f01c0ef2f729, disabling compactions & flushes 2023-09-27 04:00:33,947 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:33,947 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:33,947 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. after waiting 0 ms 2023-09-27 04:00:33,948 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:33,948 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:33,948 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e68891c228a7144b5752f01c0ef2f729: 2023-09-27 04:00:33,956 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:00:33,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695787233957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787233957"}]},"ts":"1695787233957"} 2023-09-27 04:00:33,961 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 04:00:33,963 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:00:33,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787233963"}]},"ts":"1695787233963"} 2023-09-27 04:00:33,968 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-27 04:00:33,972 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:00:33,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:00:33,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:00:33,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:00:33,974 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:00:33,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e68891c228a7144b5752f01c0ef2f729, ASSIGN}] 2023-09-27 04:00:33,982 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e68891c228a7144b5752f01c0ef2f729, ASSIGN 2023-09-27 04:00:33,985 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e68891c228a7144b5752f01c0ef2f729, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44775,1695787230832; forceNewPlan=false, retain=false 2023-09-27 04:00:33,991 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 04:00:34,136 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 04:00:34,137 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e68891c228a7144b5752f01c0ef2f729, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:34,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695787234137"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787234137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787234137"}]},"ts":"1695787234137"} 2023-09-27 04:00:34,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e68891c228a7144b5752f01c0ef2f729, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:00:34,191 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 04:00:34,295 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:34,295 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 04:00:34,297 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 04:00:34,304 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:34,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e68891c228a7144b5752f01c0ef2f729, NAME => 'hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.', STARTKEY => '', ENDKEY => ''} 2023-09-27 04:00:34,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. service=AccessControlService 2023-09-27 04:00:34,305 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:34,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:34,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,309 INFO [StoreOpener-e68891c228a7144b5752f01c0ef2f729-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,314 DEBUG [StoreOpener-e68891c228a7144b5752f01c0ef2f729-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/l 2023-09-27 04:00:34,314 DEBUG [StoreOpener-e68891c228a7144b5752f01c0ef2f729-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/l 2023-09-27 04:00:34,315 INFO [StoreOpener-e68891c228a7144b5752f01c0ef2f729-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e68891c228a7144b5752f01c0ef2f729 columnFamilyName l 2023-09-27 04:00:34,316 INFO [StoreOpener-e68891c228a7144b5752f01c0ef2f729-1] regionserver.HStore(310): Store=e68891c228a7144b5752f01c0ef2f729/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:34,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,321 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,325 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:00:34,330 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:00:34,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e68891c228a7144b5752f01c0ef2f729; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65184775, jitterRate=-0.028671160340309143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:00:34,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e68891c228a7144b5752f01c0ef2f729: 2023-09-27 04:00:34,334 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729., pid=11, masterSystemTime=1695787234295 2023-09-27 04:00:34,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:34,341 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:00:34,343 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e68891c228a7144b5752f01c0ef2f729, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:34,343 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695787234343"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787234343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787234343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787234343"}]},"ts":"1695787234343"} 2023-09-27 04:00:34,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-27 04:00:34,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e68891c228a7144b5752f01c0ef2f729, server=jenkins-hbase17.apache.org,44775,1695787230832 in 207 msec 2023-09-27 04:00:34,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-27 04:00:34,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e68891c228a7144b5752f01c0ef2f729, ASSIGN in 379 msec 2023-09-27 04:00:34,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:00:34,360 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787234359"}]},"ts":"1695787234359"} 2023-09-27 04:00:34,362 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-27 04:00:34,365 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:00:34,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 500 msec 2023-09-27 04:00:34,491 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 04:00:34,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-27 04:00:34,499 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-27 04:00:35,137 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:35,430 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:35,436 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_45781_jobhistory____.68wg7w/webapp 2023-09-27 04:00:35,587 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-27 04:00:35,587 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-27 04:00:35,588 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 04:00:35,590 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 04:00:35,664 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:35,951 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:36,323 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-27 04:00:36,365 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:45781 2023-09-27 04:00:36,632 WARN [Listener at jenkins-hbase17.apache.org/46257] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:36,878 WARN [Listener at jenkins-hbase17.apache.org/46257] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 04:00:36,879 INFO [Listener at jenkins-hbase17.apache.org/46257] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:36,891 INFO [Listener at jenkins-hbase17.apache.org/46257] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_44387_cluster____unxkqu/webapp 2023-09-27 04:00:36,961 INFO [Listener at jenkins-hbase17.apache.org/46257] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 04:00:36,962 INFO [Listener at jenkins-hbase17.apache.org/46257] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-27 04:00:36,962 INFO [Listener at jenkins-hbase17.apache.org/46257] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 04:00:36,962 INFO [Listener at jenkins-hbase17.apache.org/46257] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 04:00:36,972 INFO [Listener at jenkins-hbase17.apache.org/46257] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:37,166 INFO [Listener at jenkins-hbase17.apache.org/46257] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:37,257 INFO [Listener at jenkins-hbase17.apache.org/46257] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:37,267 INFO [Listener at jenkins-hbase17.apache.org/46257] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:44387 2023-09-27 04:00:37,772 WARN [Listener at jenkins-hbase17.apache.org/38387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:37,831 WARN [Listener at jenkins-hbase17.apache.org/38387] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 04:00:37,831 INFO [Listener at jenkins-hbase17.apache.org/38387] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:37,839 INFO [Listener at jenkins-hbase17.apache.org/38387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_33297_node____.j9o6na/webapp 2023-09-27 04:00:37,884 INFO [Listener at jenkins-hbase17.apache.org/38387] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 04:00:37,884 INFO [Listener at jenkins-hbase17.apache.org/38387] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 04:00:37,884 INFO [Listener at jenkins-hbase17.apache.org/38387] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 04:00:37,884 INFO [Listener at jenkins-hbase17.apache.org/38387] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 04:00:37,894 INFO [Listener at jenkins-hbase17.apache.org/38387] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:37,913 INFO [Listener at jenkins-hbase17.apache.org/38387] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:38,013 INFO [Listener at jenkins-hbase17.apache.org/38387] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:38,028 INFO [Listener at jenkins-hbase17.apache.org/38387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:33297 2023-09-27 04:00:38,184 WARN [Listener at jenkins-hbase17.apache.org/37905] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 04:00:38,191 WARN [Listener at jenkins-hbase17.apache.org/37905] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 04:00:38,191 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 04:00:38,199 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_35501_node____xf09by/webapp 2023-09-27 04:00:38,256 INFO [Listener at jenkins-hbase17.apache.org/37905] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 04:00:38,256 INFO [Listener at jenkins-hbase17.apache.org/37905] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 04:00:38,256 INFO [Listener at jenkins-hbase17.apache.org/37905] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 04:00:38,256 INFO [Listener at jenkins-hbase17.apache.org/37905] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 04:00:38,266 INFO [Listener at jenkins-hbase17.apache.org/37905] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:38,281 INFO [Listener at jenkins-hbase17.apache.org/37905] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:38,327 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:00:38,382 INFO [Listener at jenkins-hbase17.apache.org/37905] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 04:00:38,394 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:35501 2023-09-27 04:00:38,452 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-27 04:00:38,455 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:00:38,533 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=173, AvailableMemoryMB=1660 2023-09-27 04:00:38,534 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-09-27 04:00:38,549 DEBUG [Listener at jenkins-hbase17.apache.org/37905] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-27 04:00:38,562 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-27 04:00:38,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 04:00:38,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:00:38,582 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:00:38,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-27 04:00:38,586 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-27 04:00:38,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:00:38,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 04:00:38,589 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-27 04:00:38,590 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-27 04:00:38,591 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:38,597 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:38,597 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 empty. 2023-09-27 04:00:38,599 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 empty. 2023-09-27 04:00:38,602 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:38,602 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:38,603 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 04:00:38,656 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-27 04:00:38,658 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => a9fb0d07b7585cec32bec58cf2ad71f7, NAME => 'testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:00:38,659 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e48dd67d1716fcd524f84162ceeebc10, NAME => 'testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:00:38,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 04:00:38,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:38,730 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing a9fb0d07b7585cec32bec58cf2ad71f7, disabling compactions & flushes 2023-09-27 04:00:38,730 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:38,730 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:38,730 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. after waiting 0 ms 2023-09-27 04:00:38,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:38,734 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:38,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for a9fb0d07b7585cec32bec58cf2ad71f7: 2023-09-27 04:00:38,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:38,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e48dd67d1716fcd524f84162ceeebc10, disabling compactions & flushes 2023-09-27 04:00:38,735 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:38,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:38,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. after waiting 0 ms 2023-09-27 04:00:38,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:38,735 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:38,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e48dd67d1716fcd524f84162ceeebc10: 2023-09-27 04:00:38,739 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:00:38,741 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787238741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787238741"}]},"ts":"1695787238741"} 2023-09-27 04:00:38,741 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787238741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787238741"}]},"ts":"1695787238741"} 2023-09-27 04:00:38,802 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:00:38,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:00:38,804 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787238804"}]},"ts":"1695787238804"} 2023-09-27 04:00:38,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-27 04:00:38,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:00:38,813 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:00:38,813 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:00:38,813 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:00:38,813 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:00:38,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, ASSIGN}] 2023-09-27 04:00:38,817 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, ASSIGN 2023-09-27 04:00:38,817 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, ASSIGN 2023-09-27 04:00:38,820 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44775,1695787230832; forceNewPlan=false, retain=false 2023-09-27 04:00:38,821 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:00:38,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 04:00:38,970 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:00:38,973 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e48dd67d1716fcd524f84162ceeebc10, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:38,973 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a9fb0d07b7585cec32bec58cf2ad71f7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:38,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787238972"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787238972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787238972"}]},"ts":"1695787238972"} 2023-09-27 04:00:38,973 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787238972"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787238972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787238972"}]},"ts":"1695787238972"} 2023-09-27 04:00:38,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure a9fb0d07b7585cec32bec58cf2ad71f7, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:00:38,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure e48dd67d1716fcd524f84162ceeebc10, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:00:39,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:39,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e48dd67d1716fcd524f84162ceeebc10, NAME => 'testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 04:00:39,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. service=AccessControlService 2023-09-27 04:00:39,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:39,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:39,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:39,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9fb0d07b7585cec32bec58cf2ad71f7, NAME => 'testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 04:00:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. service=AccessControlService 2023-09-27 04:00:39,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:00:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:00:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,144 INFO [StoreOpener-a9fb0d07b7585cec32bec58cf2ad71f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,144 INFO [StoreOpener-e48dd67d1716fcd524f84162ceeebc10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,146 DEBUG [StoreOpener-e48dd67d1716fcd524f84162ceeebc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf 2023-09-27 04:00:39,146 DEBUG [StoreOpener-e48dd67d1716fcd524f84162ceeebc10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf 2023-09-27 04:00:39,149 DEBUG [StoreOpener-a9fb0d07b7585cec32bec58cf2ad71f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf 2023-09-27 04:00:39,149 DEBUG [StoreOpener-a9fb0d07b7585cec32bec58cf2ad71f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf 2023-09-27 04:00:39,150 INFO [StoreOpener-e48dd67d1716fcd524f84162ceeebc10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e48dd67d1716fcd524f84162ceeebc10 columnFamilyName cf 2023-09-27 04:00:39,150 INFO [StoreOpener-a9fb0d07b7585cec32bec58cf2ad71f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9fb0d07b7585cec32bec58cf2ad71f7 columnFamilyName cf 2023-09-27 04:00:39,153 INFO [StoreOpener-e48dd67d1716fcd524f84162ceeebc10-1] regionserver.HStore(310): Store=e48dd67d1716fcd524f84162ceeebc10/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:39,154 INFO [StoreOpener-a9fb0d07b7585cec32bec58cf2ad71f7-1] regionserver.HStore(310): Store=a9fb0d07b7585cec32bec58cf2ad71f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:00:39,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:00:39,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:00:39,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:00:39,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:00:39,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a9fb0d07b7585cec32bec58cf2ad71f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72198332, jitterRate=0.07583898305892944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:00:39,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a9fb0d07b7585cec32bec58cf2ad71f7: 2023-09-27 04:00:39,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e48dd67d1716fcd524f84162ceeebc10; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62807407, jitterRate=-0.06409670412540436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:00:39,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e48dd67d1716fcd524f84162ceeebc10: 2023-09-27 04:00:39,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10., pid=16, masterSystemTime=1695787239129 2023-09-27 04:00:39,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7., pid=15, masterSystemTime=1695787239128 2023-09-27 04:00:39,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:39,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:39,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e48dd67d1716fcd524f84162ceeebc10, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,192 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787239191"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787239191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787239191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787239191"}]},"ts":"1695787239191"} 2023-09-27 04:00:39,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:39,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:39,193 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a9fb0d07b7585cec32bec58cf2ad71f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,195 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787239193"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787239193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787239193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787239193"}]},"ts":"1695787239193"} 2023-09-27 04:00:39,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 04:00:39,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-27 04:00:39,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure e48dd67d1716fcd524f84162ceeebc10, server=jenkins-hbase17.apache.org,44775,1695787230832 in 220 msec 2023-09-27 04:00:39,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-27 04:00:39,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, ASSIGN in 390 msec 2023-09-27 04:00:39,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure a9fb0d07b7585cec32bec58cf2ad71f7, server=jenkins-hbase17.apache.org,38525,1695787230747 in 224 msec 2023-09-27 04:00:39,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-27 04:00:39,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, ASSIGN in 395 msec 2023-09-27 04:00:39,213 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:00:39,213 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787239213"}]},"ts":"1695787239213"} 2023-09-27 04:00:39,216 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-27 04:00:39,218 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:00:39,225 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-27 04:00:39,231 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,236 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,240 DEBUG [hconnection-0x7fe0bb7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,244 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,253 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 04:00:39,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 04:00:39,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 04:00:39,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 04:00:39,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 04:00:39,282 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:00:39,290 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 04:00:39,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 04:00:39,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 04:00:39,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 04:00:39,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 717 msec 2023-09-27 04:00:39,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 04:00:39,703 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-27 04:00:39,707 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 04:00:39,708 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:39,710 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:00:39,736 DEBUG [hconnection-0x749062ba-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,739 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,742 DEBUG [hconnection-0x749062ba-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,748 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 04:00:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787239762 (current time:1695787239762). 2023-09-27 04:00:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:00:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x0be31656 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:39,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e1547aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:39,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,774 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0be31656 to 127.0.0.1:51909 2023-09-27 04:00:39,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:00:39,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x47ff165a to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:39,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f96ff3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:39,786 DEBUG [hconnection-0x11bafa15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,787 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:39,795 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:39,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47ff165a to 127.0.0.1:51909 2023-09-27 04:00:39,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:00:39,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 04:00:39,802 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:00:39,803 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-27 04:00:39,803 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:00:39,803 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-27 04:00:39,803 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 04:00:39,803 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-27 04:00:39,804 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:00:39,804 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-27 04:00:39,804 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 04:00:39,804 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-27 04:00:39,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:00:39,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 04:00:39,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 04:00:39,842 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 04:00:39,843 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695787839843 2023-09-27 04:00:39,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 04:00:39,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 04:00:39,847 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 04:00:39,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 04:00:39,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-27 04:00:39,851 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 04:00:39,852 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695787839852 2023-09-27 04:00:39,853 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:00:39,853 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:00:39,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,876 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-27 04:00:39,876 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:39,877 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 04:00:39,877 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 04:00:39,878 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,878 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,880 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,881 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:39,881 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:39,880 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:39,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:39,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:39,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:39,881 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:39,881 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,882 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,882 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 04:00:39,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 04:00:39,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 04:00:39,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 04:00:39,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,889 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 04:00:39,889 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:39,889 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 04:00:39,889 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 04:00:39,890 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:39,890 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 04:00:39,891 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 04:00:39,891 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 04:00:39,891 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:39,891 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 04:00:39,891 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 04:00:39,892 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 04:00:39,892 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 04:00:39,892 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 04:00:39,892 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,895 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,895 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:00:39,895 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,896 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:00:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:39,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 04:00:39,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31e9f72e[Count = 1] remaining members to acquire global barrier 2023-09-27 04:00:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:39,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:39,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 04:00:39,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31e9f72e[Count = 0] remaining members to acquire global barrier 2023-09-27 04:00:39,901 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 04:00:39,901 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,903 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 04:00:39,903 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 04:00:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,904 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,904 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:00:39,904 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:00:39,905 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:00:39,905 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:39,905 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:00:39,905 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:39,905 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:00:39,905 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 04:00:39,905 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 04:00:39,905 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:00:39,905 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. started... 2023-09-27 04:00:39,905 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. started... 2023-09-27 04:00:39,909 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 04:00:39,909 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:39,909 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 04:00:39,911 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e48dd67d1716fcd524f84162ceeebc10: 2023-09-27 04:00:39,911 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9fb0d07b7585cec32bec58cf2ad71f7: 2023-09-27 04:00:39,912 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,912 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,917 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:00:39,917 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:00:39,921 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:00:39,921 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:00:39,953 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:39,953 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. completed. 2023-09-27 04:00:39,954 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:39,954 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:00:39,954 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:00:39,954 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,954 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 04:00:39,955 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:00:39,956 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,957 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 04:00:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,957 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:39,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:39,957 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 04:00:39,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,961 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. completed. 2023-09-27 04:00:39,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:00:39,961 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:39,961 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:00:39,961 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:00:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,961 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,961 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 04:00:39,961 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:00:39,961 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:00:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:39,962 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,963 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 04:00:39,963 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,963 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 04:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 04:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 04:00:39,971 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-27 04:00:39,971 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:00:39,971 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:00:39,971 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,971 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:39,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:39,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:39,975 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:39,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:39,976 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,981 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,981 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:39,982 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:39,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:39,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,998 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:39,998 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:39,998 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:39,998 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:39,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:39,997 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:39,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:39,999 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,000 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:39,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:40,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 04:00:40,000 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,000 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:40,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:00:40,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:40,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 04:00:40,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,083 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 04:00:40,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,084 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 04:00:40,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695787239844Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695787240020 (+176 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695787240020Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695787240021 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695787240039 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695787240068 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695787240083 (+15 ms) 2023-09-27 04:00:40,086 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 04:00:40,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 240 msec 2023-09-27 04:00:40,162 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:40,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:40,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:00:40,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38525] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:00:40,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44775] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:00:40,186 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 04:00:40,186 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:40,186 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:00:40,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 04:00:40,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787240204 (current time:1695787240204). 2023-09-27 04:00:40,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:00:40,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x7652ab25 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:40,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb033ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:40,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:40,215 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:40,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7652ab25 to 127.0.0.1:51909 2023-09-27 04:00:40,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:00:40,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x4b9f22ce to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:00:40,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28f7a31b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:00:40,321 DEBUG [hconnection-0x3242daba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:40,325 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:40,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:00:40,335 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:00:40,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b9f22ce to 127.0.0.1:51909 2023-09-27 04:00:40,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:00:40,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 04:00:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:00:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 04:00:40,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 04:00:40,342 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 04:00:40,344 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695787840344 2023-09-27 04:00:40,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 04:00:40,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 04:00:40,346 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:00:40,346 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:00:40,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 04:00:40,348 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 04:00:40,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-27 04:00:40,352 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 04:00:40,353 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695787840353 2023-09-27 04:00:40,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-27 04:00:40,377 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-27 04:00:40,377 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:40,379 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 04:00:40,379 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 04:00:40,380 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,380 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,381 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:40,381 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:40,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:40,381 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:40,381 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:40,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:40,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:40,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:40,382 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,382 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,383 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,383 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 04:00:40,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 04:00:40,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 04:00:40,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 04:00:40,384 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 04:00:40,384 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 04:00:40,384 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:40,384 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:40,385 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 04:00:40,385 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 04:00:40,385 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 04:00:40,385 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 04:00:40,385 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 04:00:40,385 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 04:00:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,388 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:40,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:40,389 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,389 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:40,389 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,389 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:00:40,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:40,389 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,390 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 04:00:40,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:40,390 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 04:00:40,390 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:00:40,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 04:00:40,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 04:00:40,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 04:00:40,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:40,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 04:00:40,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@705a5496[Count = 1] remaining members to acquire global barrier 2023-09-27 04:00:40,393 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,393 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:40,393 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,393 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:00:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:40,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 04:00:40,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@705a5496[Count = 0] remaining members to acquire global barrier 2023-09-27 04:00:40,401 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 04:00:40,401 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 04:00:40,403 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 04:00:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:40,403 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,404 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:00:40,404 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 04:00:40,404 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 04:00:40,404 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:00:40,405 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:00:40,406 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:40,406 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:00:40,407 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. started... 2023-09-27 04:00:40,406 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:40,406 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:00:40,407 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:00:40,407 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. started... 2023-09-27 04:00:40,407 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 04:00:40,407 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:40,407 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 04:00:40,408 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e48dd67d1716fcd524f84162ceeebc10 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-27 04:00:40,407 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a9fb0d07b7585cec32bec58cf2ad71f7 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-27 04:00:40,446 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:40,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:40,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:00:40,448 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:00:40,588 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927f7f06f260f5347d6a39e74bf80315cf5 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927f7f06f260f5347d6a39e74bf80315cf5 2023-09-27 04:00:40,588 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092754741954eb83400db2fc0ccd60f6d438 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092754741954eb83400db2fc0ccd60f6d438 2023-09-27 04:00:40,648 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:40,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:40,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:00:40,679 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 04:00:40,692 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/.tmp/cf/f27d62e5be8743d79be579da362b7707 2023-09-27 04:00:40,699 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/.tmp/cf/0784f07dce774738b746c1c5bee1cc17 2023-09-27 04:00:40,711 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/.tmp/cf/f27d62e5be8743d79be579da362b7707 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf/f27d62e5be8743d79be579da362b7707 2023-09-27 04:00:40,717 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/.tmp/cf/0784f07dce774738b746c1c5bee1cc17 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf/0784f07dce774738b746c1c5bee1cc17 2023-09-27 04:00:40,726 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf/f27d62e5be8743d79be579da362b7707, entries=2, sequenceid=6, filesize=5.2 K 2023-09-27 04:00:40,731 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a9fb0d07b7585cec32bec58cf2ad71f7 in 324ms, sequenceid=6, compaction requested=false 2023-09-27 04:00:40,731 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 04:00:40,732 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9fb0d07b7585cec32bec58cf2ad71f7: 2023-09-27 04:00:40,733 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 04:00:40,733 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:00:40,734 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf/f27d62e5be8743d79be579da362b7707] hfiles 2023-09-27 04:00:40,734 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf/f27d62e5be8743d79be579da362b7707 for snapshot=snaptb0-testExportWithTargetName 2023-09-27 04:00:40,748 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf/0784f07dce774738b746c1c5bee1cc17, entries=48, sequenceid=6, filesize=13.0 K 2023-09-27 04:00:40,754 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e48dd67d1716fcd524f84162ceeebc10 in 347ms, sequenceid=6, compaction requested=false 2023-09-27 04:00:40,756 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e48dd67d1716fcd524f84162ceeebc10: 2023-09-27 04:00:40,756 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 04:00:40,756 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:00:40,757 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf/0784f07dce774738b746c1c5bee1cc17] hfiles 2023-09-27 04:00:40,757 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf/0784f07dce774738b746c1c5bee1cc17 for snapshot=snaptb0-testExportWithTargetName 2023-09-27 04:00:40,832 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. completed. 2023-09-27 04:00:40,840 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:00:40,840 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:00:40,841 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:00:40,841 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,841 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 04:00:40,841 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:00:40,843 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,843 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 04:00:40,843 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:40,843 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 04:00:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:40,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:40,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:40,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:40,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:40,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:40,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:40,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:40,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:40,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:40,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:40,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:00:40,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 04:00:40,979 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:40,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:40,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:00:40,982 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-27 04:00:41,233 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. completed. 2023-09-27 04:00:41,233 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:00:41,234 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:00:41,234 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:00:41,234 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,234 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 04:00:41,234 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:00:41,236 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,245 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 04:00:41,245 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:41,245 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 04:00:41,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:00:41,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 04:00:41,247 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-27 04:00:41,248 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:00:41,248 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:00:41,248 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-27 04:00:41,248 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:00:41,249 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,249 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:41,249 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:41,249 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,249 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:00:41,250 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:41,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:41,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:00:41,252 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:41,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:41,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:41,253 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:00:41,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,254 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:41,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,264 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:00:41,264 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 04:00:41,265 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,286 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,286 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,286 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,287 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:41,287 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:41,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:41,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:41,287 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:41,287 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:00:41,288 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:00:41,287 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:00:41,290 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:00:41,290 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-27 04:00:41,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 04:00:41,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:41,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:41,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:00:41,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:00:41,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 04:00:41,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:00:41,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:00:41,291 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:00:41,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927f7f06f260f5347d6a39e74bf80315cf5, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092754741954eb83400db2fc0ccd60f6d438] mob files 2023-09-27 04:00:41,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927f7f06f260f5347d6a39e74bf80315cf5 2023-09-27 04:00:41,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092754741954eb83400db2fc0ccd60f6d438 2023-09-27 04:00:41,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-27 04:00:41,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,482 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:41,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:41,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:00:41,488 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-09-27 04:00:41,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,544 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 04:00:41,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 04:00:41,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695787240344Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695787241326 (+982 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695787241326Loading Region manifests for snaptb0-testExportWithTargetName at 1695787241326Writing data manifest for snaptb0-testExportWithTargetName at 1695787241360 (+34 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695787241501 (+141 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695787241544 (+43 ms) 2023-09-27 04:00:41,553 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 04:00:41,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.2080 sec 2023-09-27 04:00:42,488 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:00:42,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 04:00:42,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:00:42,492 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492 2023-09-27 04:00:42,492 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39783, tgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492, rawTgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:00:42,538 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:00:42,538 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_934571404_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 04:00:42,538 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-27 04:00:42,568 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 04:00:42,728 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:42,729 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:42,729 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:42,730 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,886 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-3253446211265743567.jar 2023-09-27 04:00:43,886 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,887 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,972 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-1278101207237005527.jar 2023-09-27 04:00:43,973 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,974 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,974 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,975 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,976 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,976 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:00:43,977 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:00:43,977 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:00:43,978 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:00:43,978 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:00:43,979 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:00:43,980 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:00:43,980 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:00:43,980 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:00:43,981 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:00:43,982 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:00:43,986 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:00:43,987 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:00:43,987 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:00:43,987 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:00:43,988 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:00:43,988 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:00:43,989 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:00:44,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:00:45,554 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:00:45,576 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-27 04:00:45,589 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 04:00:46,373 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:00:46,373 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:00:46,646 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0001_000001 (auth:SIMPLE) 2023-09-27 04:00:53,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0001_000001 (auth:SIMPLE) 2023-09-27 04:00:56,248 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0001_000001 (auth:SIMPLE) 2023-09-27 04:01:02,870 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:01:02,872 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:01:02,885 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-27 04:01:02,886 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:01:02,887 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:01:02,887 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 04:01:02,888 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-27 04:01:02,888 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-27 04:01:02,888 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492/.hbase-snapshot/testExportWithTargetName 2023-09-27 04:01:02,889 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-27 04:01:02,889 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787242492/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-27 04:01:02,904 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-27 04:01:02,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-09-27 04:01:02,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:02,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 04:01:02,931 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787262931"}]},"ts":"1695787262931"} 2023-09-27 04:01:02,934 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-27 04:01:02,935 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-27 04:01:02,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, UNASSIGN}] 2023-09-27 04:01:02,942 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, UNASSIGN 2023-09-27 04:01:02,942 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, UNASSIGN 2023-09-27 04:01:02,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e48dd67d1716fcd524f84162ceeebc10, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:02,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a9fb0d07b7585cec32bec58cf2ad71f7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:02,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787262943"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787262943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787262943"}]},"ts":"1695787262943"} 2023-09-27 04:01:02,944 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787262943"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787262943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787262943"}]},"ts":"1695787262943"} 2023-09-27 04:01:02,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e48dd67d1716fcd524f84162ceeebc10, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:01:02,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure a9fb0d07b7585cec32bec58cf2ad71f7, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:03,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 04:01:03,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:01:03,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e48dd67d1716fcd524f84162ceeebc10, disabling compactions & flushes 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a9fb0d07b7585cec32bec58cf2ad71f7, disabling compactions & flushes 2023-09-27 04:01:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:01:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. after waiting 0 ms 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. after waiting 0 ms 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:01:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:01:03,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:01:03,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:01:03,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:03,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:03,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7. 2023-09-27 04:01:03,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10. 2023-09-27 04:01:03,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a9fb0d07b7585cec32bec58cf2ad71f7: 2023-09-27 04:01:03,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e48dd67d1716fcd524f84162ceeebc10: 2023-09-27 04:01:03,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:01:03,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a9fb0d07b7585cec32bec58cf2ad71f7, regionState=CLOSED 2023-09-27 04:01:03,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:01:03,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787263134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787263134"}]},"ts":"1695787263134"} 2023-09-27 04:01:03,135 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e48dd67d1716fcd524f84162ceeebc10, regionState=CLOSED 2023-09-27 04:01:03,136 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695787263135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787263135"}]},"ts":"1695787263135"} 2023-09-27 04:01:03,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-27 04:01:03,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure a9fb0d07b7585cec32bec58cf2ad71f7, server=jenkins-hbase17.apache.org,38525,1695787230747 in 190 msec 2023-09-27 04:01:03,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-27 04:01:03,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e48dd67d1716fcd524f84162ceeebc10, server=jenkins-hbase17.apache.org,44775,1695787230832 in 194 msec 2023-09-27 04:01:03,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9fb0d07b7585cec32bec58cf2ad71f7, UNASSIGN in 204 msec 2023-09-27 04:01:03,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-27 04:01:03,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e48dd67d1716fcd524f84162ceeebc10, UNASSIGN in 205 msec 2023-09-27 04:01:03,147 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787263147"}]},"ts":"1695787263147"} 2023-09-27 04:01:03,149 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-27 04:01:03,150 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-27 04:01:03,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 234 msec 2023-09-27 04:01:03,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 04:01:03,234 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-27 04:01:03,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-09-27 04:01:03,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:03,253 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-27 04:01:03,256 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:03,259 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-27 04:01:03,263 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:01:03,263 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:01:03,265 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,265 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,265 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,265 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 04:01:03,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 04:01:03,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 04:01:03,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 04:01:03,267 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,267 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:03,267 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,267 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:03,268 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,268 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:03,268 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 04:01:03,268 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:03,269 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/recovered.edits] 2023-09-27 04:01:03,270 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/recovered.edits] 2023-09-27 04:01:03,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 04:01:03,280 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf/0784f07dce774738b746c1c5bee1cc17 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/cf/0784f07dce774738b746c1c5bee1cc17 2023-09-27 04:01:03,280 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf/f27d62e5be8743d79be579da362b7707 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/cf/f27d62e5be8743d79be579da362b7707 2023-09-27 04:01:03,285 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10/recovered.edits/9.seqid 2023-09-27 04:01:03,285 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7/recovered.edits/9.seqid 2023-09-27 04:01:03,286 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/e48dd67d1716fcd524f84162ceeebc10 2023-09-27 04:01:03,286 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportWithTargetName/a9fb0d07b7585cec32bec58cf2ad71f7 2023-09-27 04:01:03,286 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 04:01:03,287 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 04:01:03,288 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-27 04:01:03,294 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927f7f06f260f5347d6a39e74bf80315cf5 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230927f7f06f260f5347d6a39e74bf80315cf5 2023-09-27 04:01:03,296 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092754741954eb83400db2fc0ccd60f6d438 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092754741954eb83400db2fc0ccd60f6d438 2023-09-27 04:01:03,297 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 04:01:03,301 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:03,331 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-27 04:01:03,340 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-27 04:01:03,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:03,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-27 04:01:03,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787263343"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:03,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787263343"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:03,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 04:01:03,348 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a9fb0d07b7585cec32bec58cf2ad71f7, NAME => 'testtb-testExportWithTargetName,,1695787238574.a9fb0d07b7585cec32bec58cf2ad71f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e48dd67d1716fcd524f84162ceeebc10, NAME => 'testtb-testExportWithTargetName,1,1695787238574.e48dd67d1716fcd524f84162ceeebc10.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 04:01:03,348 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-27 04:01:03,349 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787263348"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:03,362 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-27 04:01:03,368 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 04:01:03,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 126 msec 2023-09-27 04:01:03,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 04:01:03,375 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-27 04:01:03,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-27 04:01:03,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-27 04:01:03,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-09-27 04:01:03,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-27 04:01:03,457 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 709) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1841928159_1 at /127.0.0.1:34364 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:36578 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:33745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:52460 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:34382 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:33579 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1286 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1841928159_1 at /127.0.0.1:52424 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:38387 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=629 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=1220 (was 1660) 2023-09-27 04:01:03,457 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-27 04:01:03,481 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=629, ProcessCount=175, AvailableMemoryMB=1219 2023-09-27 04:01:03,481 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-27 04:01:03,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 04:01:03,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:03,492 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:01:03,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-27 04:01:03,494 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:01:03,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 04:01:03,508 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:03,511 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:03,513 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 empty. 2023-09-27 04:01:03,514 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 empty. 2023-09-27 04:01:03,514 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:03,514 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:03,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 04:01:03,584 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 04:01:03,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 04:01:03,598 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => fc894930ce26e8b402dd7783110eaf54, NAME => 'testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:03,601 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3a333d503f88e9af39de7dcfd74adf14, NAME => 'testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:03,713 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:03,720 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3a333d503f88e9af39de7dcfd74adf14, disabling compactions & flushes 2023-09-27 04:01:03,720 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:03,720 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:03,720 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. after waiting 0 ms 2023-09-27 04:01:03,720 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:03,720 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:03,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3a333d503f88e9af39de7dcfd74adf14: 2023-09-27 04:01:03,723 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:03,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing fc894930ce26e8b402dd7783110eaf54, disabling compactions & flushes 2023-09-27 04:01:03,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:03,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:03,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. after waiting 0 ms 2023-09-27 04:01:03,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:03,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:03,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for fc894930ce26e8b402dd7783110eaf54: 2023-09-27 04:01:03,728 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:01:03,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787263728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787263728"}]},"ts":"1695787263728"} 2023-09-27 04:01:03,729 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787263728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787263728"}]},"ts":"1695787263728"} 2023-09-27 04:01:03,732 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:01:03,733 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:01:03,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787263733"}]},"ts":"1695787263733"} 2023-09-27 04:01:03,738 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 04:01:03,741 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:01:03,742 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:01:03,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:01:03,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:01:03,743 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:01:03,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, ASSIGN}] 2023-09-27 04:01:03,747 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, ASSIGN 2023-09-27 04:01:03,747 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, ASSIGN 2023-09-27 04:01:03,749 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44775,1695787230832; forceNewPlan=false, retain=false 2023-09-27 04:01:03,749 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:01:03,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 04:01:03,899 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:01:03,902 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3a333d503f88e9af39de7dcfd74adf14, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:03,902 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fc894930ce26e8b402dd7783110eaf54, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:03,902 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787263902"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787263902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787263902"}]},"ts":"1695787263902"} 2023-09-27 04:01:03,902 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787263902"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787263902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787263902"}]},"ts":"1695787263902"} 2023-09-27 04:01:03,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure fc894930ce26e8b402dd7783110eaf54, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:01:03,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 3a333d503f88e9af39de7dcfd74adf14, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:04,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:04,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc894930ce26e8b402dd7783110eaf54, NAME => 'testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 04:01:04,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. service=AccessControlService 2023-09-27 04:01:04,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:04,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:04,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,065 INFO [StoreOpener-fc894930ce26e8b402dd7783110eaf54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:04,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a333d503f88e9af39de7dcfd74adf14, NAME => 'testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 04:01:04,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. service=AccessControlService 2023-09-27 04:01:04,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:04,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:04,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,071 DEBUG [StoreOpener-fc894930ce26e8b402dd7783110eaf54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf 2023-09-27 04:01:04,071 DEBUG [StoreOpener-fc894930ce26e8b402dd7783110eaf54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf 2023-09-27 04:01:04,072 INFO [StoreOpener-fc894930ce26e8b402dd7783110eaf54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc894930ce26e8b402dd7783110eaf54 columnFamilyName cf 2023-09-27 04:01:04,073 INFO [StoreOpener-3a333d503f88e9af39de7dcfd74adf14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,075 INFO [StoreOpener-fc894930ce26e8b402dd7783110eaf54-1] regionserver.HStore(310): Store=fc894930ce26e8b402dd7783110eaf54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:04,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,081 DEBUG [StoreOpener-3a333d503f88e9af39de7dcfd74adf14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf 2023-09-27 04:01:04,081 DEBUG [StoreOpener-3a333d503f88e9af39de7dcfd74adf14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf 2023-09-27 04:01:04,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,081 INFO [StoreOpener-3a333d503f88e9af39de7dcfd74adf14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a333d503f88e9af39de7dcfd74adf14 columnFamilyName cf 2023-09-27 04:01:04,083 INFO [StoreOpener-3a333d503f88e9af39de7dcfd74adf14-1] regionserver.HStore(310): Store=3a333d503f88e9af39de7dcfd74adf14/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:04,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:04,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:04,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 04:01:04,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fc894930ce26e8b402dd7783110eaf54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61290356, jitterRate=-0.08670252561569214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:04,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:04,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fc894930ce26e8b402dd7783110eaf54: 2023-09-27 04:01:04,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54., pid=30, masterSystemTime=1695787264058 2023-09-27 04:01:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:04,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:04,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:04,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fc894930ce26e8b402dd7783110eaf54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3a333d503f88e9af39de7dcfd74adf14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65830619, jitterRate=-0.019047334790229797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:04,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3a333d503f88e9af39de7dcfd74adf14: 2023-09-27 04:01:04,107 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787264107"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787264107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787264107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787264107"}]},"ts":"1695787264107"} 2023-09-27 04:01:04,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14., pid=31, masterSystemTime=1695787264062 2023-09-27 04:01:04,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:04,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:04,114 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3a333d503f88e9af39de7dcfd74adf14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,115 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787264114"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787264114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787264114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787264114"}]},"ts":"1695787264114"} 2023-09-27 04:01:04,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-27 04:01:04,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure fc894930ce26e8b402dd7783110eaf54, server=jenkins-hbase17.apache.org,44775,1695787230832 in 206 msec 2023-09-27 04:01:04,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, ASSIGN in 373 msec 2023-09-27 04:01:04,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-27 04:01:04,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 3a333d503f88e9af39de7dcfd74adf14, server=jenkins-hbase17.apache.org,38525,1695787230747 in 212 msec 2023-09-27 04:01:04,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-27 04:01:04,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, ASSIGN in 380 msec 2023-09-27 04:01:04,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:01:04,128 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787264128"}]},"ts":"1695787264128"} 2023-09-27 04:01:04,130 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 04:01:04,134 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:01:04,134 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-27 04:01:04,139 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 04:01:04,140 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:04,140 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:04,141 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:04,141 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:04,142 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:04,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:04,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:04,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:04,143 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:04,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 658 msec 2023-09-27 04:01:04,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 04:01:04,601 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-27 04:01:04,606 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 04:01:04,606 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:04,610 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:01:04,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:01:04,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787264637 (current time:1695787264637). 2023-09-27 04:01:04,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:04,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x124ba116 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:04,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31eb37d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:04,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:04,652 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:04,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x124ba116 to 127.0.0.1:51909 2023-09-27 04:01:04,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:04,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x36592057 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:04,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7955649b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:04,669 DEBUG [hconnection-0x1168a9e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:04,675 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:04,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:04,689 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:04,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36592057 to 127.0.0.1:51909 2023-09-27 04:01:04,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:04,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 04:01:04,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:04,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:01:04,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:01:04,699 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:01:04,709 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695787864709 2023-09-27 04:01:04,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:01:04,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 04:01:04,709 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:04,709 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:04,713 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:01:04,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 04:01:04,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 17 msec 2023-09-27 04:01:04,718 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 04:01:04,721 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695787864721 2023-09-27 04:01:04,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,773 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-27 04:01:04,773 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:04,775 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 04:01:04,775 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 04:01:04,776 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,776 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:04,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:04,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:04,777 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:04,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:04,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,778 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,778 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,779 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,779 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 04:01:04,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 04:01:04,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 04:01:04,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,780 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 04:01:04,780 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:04,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,783 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 04:01:04,783 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 04:01:04,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,783 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:04,783 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 04:01:04,785 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 04:01:04,786 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 04:01:04,784 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 04:01:04,786 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 04:01:04,785 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 04:01:04,786 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:04,787 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 04:01:04,787 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 04:01:04,787 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 04:01:04,789 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,789 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:04,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:04,795 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,795 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:04,795 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:04,795 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,795 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,796 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,796 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:04,796 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,796 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 04:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6298b26[Count = 1] remaining members to acquire global barrier 2023-09-27 04:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:04,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 04:01:04,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6298b26[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:04,804 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 04:01:04,804 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,805 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,805 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,806 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:01:04,806 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 04:01:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,806 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:04,806 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:01:04,806 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,807 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:01:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 04:01:04,807 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,807 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:04,807 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 04:01:04,809 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:04,822 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:04,822 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:04,822 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:04,822 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:04,821 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:04,823 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. started... 2023-09-27 04:01:04,823 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc894930ce26e8b402dd7783110eaf54: 2023-09-27 04:01:04,824 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,824 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:04,824 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:01:04,825 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:04,825 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. started... 2023-09-27 04:01:04,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:04,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:04,826 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:01:04,829 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a333d503f88e9af39de7dcfd74adf14: 2023-09-27 04:01:04,829 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,829 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:04,830 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:01:04,868 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. completed. 2023-09-27 04:01:04,868 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:04,868 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:04,868 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:04,868 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,868 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 04:01:04,868 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:04,870 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 04:01:04,870 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:04,870 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:04,871 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 04:01:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,881 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. completed. 2023-09-27 04:01:04,881 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:04,881 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:04,881 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:04,881 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,881 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 04:01:04,881 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:01:04,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 04:01:04,884 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 04:01:04,885 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:04,888 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 04:01:04,889 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:04,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:04,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:01:04,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 04:01:04,894 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-27 04:01:04,894 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:04,894 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:04,894 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,894 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:04,896 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:04,897 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:04,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,897 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:04,898 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:04,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:04,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:04,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:04,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:04,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:04,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:04,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:04,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:04,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,903 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,905 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,906 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,912 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,913 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,914 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:04,919 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:04,920 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:04,920 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,920 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:04,920 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:04,920 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:04,920 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,921 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,920 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 04:01:04,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:04,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:01:04,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 04:01:04,920 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:04,920 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:04,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:04,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:04,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:05,026 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:05,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:05,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:05,029 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 04:01:05,329 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:05,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:05,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:05,331 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-27 04:01:05,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:05,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:05,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:05,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 04:01:05,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:05,477 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:05,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695787264709Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695787265365 (+656 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695787265365Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695787265366 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695787265375 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695787265449 (+74 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695787265475 (+26 ms) 2023-09-27 04:01:05,481 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 04:01:05,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 769 msec 2023-09-27 04:01:05,831 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:05,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:05,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:05,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:01:05,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38525] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:01:05,844 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 04:01:05,845 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:05,845 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:01:05,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:01:05,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787265861 (current time:1695787265861). 2023-09-27 04:01:05,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:05,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x1c2cb86b to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38a1945d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:05,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:05,876 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:05,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c2cb86b to 127.0.0.1:51909 2023-09-27 04:01:05,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:05,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x743d559a to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:05,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@399c2a02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:05,888 DEBUG [hconnection-0x2cc4f454-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:05,890 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:05,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:05,904 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:05,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x743d559a to 127.0.0.1:51909 2023-09-27 04:01:05,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:05,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 04:01:05,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:05,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:01:05,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:01:05,925 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:01:05,927 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695787865927 2023-09-27 04:01:05,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:01:05,927 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 04:01:05,930 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:05,930 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:05,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 04:01:05,933 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:01:05,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-09-27 04:01:05,948 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 04:01:05,949 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695787865949 2023-09-27 04:01:05,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-27 04:01:05,989 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-27 04:01:05,989 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:05,990 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 04:01:05,991 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 04:01:05,991 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,991 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,992 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:05,992 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:05,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:05,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:05,992 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:05,992 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:05,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:05,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:05,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,994 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:05,994 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 04:01:05,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 04:01:05,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 04:01:05,995 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:05,995 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:05,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 04:01:05,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:05,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 04:01:05,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 04:01:05,997 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 04:01:05,997 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:06,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 04:01:06,002 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 04:01:06,002 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:06,004 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 04:01:06,004 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 04:01:06,004 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 04:01:06,004 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 04:01:06,004 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 04:01:06,004 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 04:01:06,007 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:06,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:06,008 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:06,009 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,012 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,012 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,013 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:06,013 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,013 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:06,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 04:01:06,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78074c4a[Count = 1] remaining members to acquire global barrier 2023-09-27 04:01:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:06,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 04:01:06,018 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 04:01:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,018 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:06,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 04:01:06,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78074c4a[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:06,027 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 04:01:06,027 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:06,030 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,030 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:01:06,031 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:01:06,031 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,031 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,031 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:06,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:06,031 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 04:01:06,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:06,031 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 04:01:06,031 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 04:01:06,032 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:01:06,033 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,033 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:01:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 04:01:06,034 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:06,035 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 04:01:06,035 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:06,035 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 04:01:06,053 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:06,053 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:06,053 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:06,053 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:06,054 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:06,054 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. started... 2023-09-27 04:01:06,054 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc894930ce26e8b402dd7783110eaf54 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-27 04:01:06,065 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:06,065 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. started... 2023-09-27 04:01:06,066 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a333d503f88e9af39de7dcfd74adf14 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-27 04:01:06,232 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:06,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:06,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:06,234 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 04:01:06,242 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927545677c3baa44474a760816a4804d083 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927545677c3baa44474a760816a4804d083 2023-09-27 04:01:06,270 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927273bd8c6c672486c8a858d359b38bff3 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927273bd8c6c672486c8a858d359b38bff3 2023-09-27 04:01:06,365 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/.tmp/cf/cc715f013e3641b9a51f5669935b6840 2023-09-27 04:01:06,378 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/.tmp/cf/cc715f013e3641b9a51f5669935b6840 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf/cc715f013e3641b9a51f5669935b6840 2023-09-27 04:01:06,406 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf/cc715f013e3641b9a51f5669935b6840, entries=1, sequenceid=6, filesize=5.1 K 2023-09-27 04:01:06,410 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for fc894930ce26e8b402dd7783110eaf54 in 356ms, sequenceid=6, compaction requested=false 2023-09-27 04:01:06,410 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-27 04:01:06,411 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc894930ce26e8b402dd7783110eaf54: 2023-09-27 04:01:06,412 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 04:01:06,412 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:06,412 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf/cc715f013e3641b9a51f5669935b6840] hfiles 2023-09-27 04:01:06,412 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf/cc715f013e3641b9a51f5669935b6840 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 04:01:06,429 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/.tmp/cf/0abcb8fc0a7143efb9876be88601d343 2023-09-27 04:01:06,469 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/.tmp/cf/0abcb8fc0a7143efb9876be88601d343 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf/0abcb8fc0a7143efb9876be88601d343 2023-09-27 04:01:06,489 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf/0abcb8fc0a7143efb9876be88601d343, entries=49, sequenceid=6, filesize=13.2 K 2023-09-27 04:01:06,490 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 3a333d503f88e9af39de7dcfd74adf14 in 425ms, sequenceid=6, compaction requested=false 2023-09-27 04:01:06,495 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a333d503f88e9af39de7dcfd74adf14: 2023-09-27 04:01:06,495 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 04:01:06,495 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:06,495 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf/0abcb8fc0a7143efb9876be88601d343] hfiles 2023-09-27 04:01:06,496 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf/0abcb8fc0a7143efb9876be88601d343 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 04:01:06,530 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. completed. 2023-09-27 04:01:06,530 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:06,531 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:06,531 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:06,531 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,534 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:06,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:06,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:06,537 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-27 04:01:06,541 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 04:01:06,541 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:06,544 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 04:01:06,544 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,544 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:06,545 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 04:01:06,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:06,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:06,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:06,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:06,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:06,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:01:06,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 04:01:06,602 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. completed. 2023-09-27 04:01:06,602 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:06,602 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:06,602 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:06,602 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,602 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 04:01:06,603 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:06,604 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 04:01:06,604 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:06,604 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 04:01:06,606 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:06,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:06,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:06,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:06,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:06,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:01:06,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 04:01:06,611 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-27 04:01:06,611 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:06,611 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:06,611 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-27 04:01:06,611 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:06,612 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,612 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,613 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:06,613 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,612 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:06,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:06,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:06,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:06,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:06,614 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,614 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,615 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,615 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:06,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:06,615 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:06,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:06,616 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:06,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:06,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:06,617 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,617 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:06,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 04:01:06,621 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:06,621 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:06,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,621 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:06,621 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:06,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-27 04:01:06,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 04:01:06,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 04:01:06,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:01:06,621 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,624 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:06,621 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:06,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:06,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:06,621 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:06,625 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,625 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:06,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:06,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927273bd8c6c672486c8a858d359b38bff3, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927545677c3baa44474a760816a4804d083] mob files 2023-09-27 04:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:06,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:06,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:06,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927273bd8c6c672486c8a858d359b38bff3 2023-09-27 04:01:06,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927545677c3baa44474a760816a4804d083 2023-09-27 04:01:06,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:06,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-09-27 04:01:06,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-27 04:01:06,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,774 WARN [DataStreamer for file /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-09-27 04:01:06,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 04:01:06,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,831 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 04:01:06,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695787265927Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695787266685 (+758 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695787266685Loading Region manifests for snaptb0-testExportFileSystemState at 1695787266685Writing data manifest for snaptb0-testExportFileSystemState at 1695787266700 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695787266792 (+92 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695787266830 (+38 ms) 2023-09-27 04:01:06,836 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 04:01:06,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 908 msec 2023-09-27 04:01:07,037 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:01:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:07,039 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039 2023-09-27 04:01:07,039 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39783, tgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039, rawTgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:07,125 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:07,125 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2100584221_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 04:01:07,125 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-27 04:01:07,189 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 04:01:07,326 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:07,327 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:07,328 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:07,328 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:07,702 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0001_000001 (auth:SIMPLE) 2023-09-27 04:01:08,358 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-4493491500434743037.jar 2023-09-27 04:01:08,358 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,358 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,420 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-3278041809258580940.jar 2023-09-27 04:01:08,421 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,421 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,421 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,422 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,422 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,423 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:08,423 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:01:08,424 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:01:08,424 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:01:08,425 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:01:08,425 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:01:08,426 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:01:08,426 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:01:08,426 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:01:08,427 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:01:08,427 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:01:08,428 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:08,428 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:08,429 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:08,429 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:08,429 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:08,430 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:08,430 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:08,737 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:01:09,095 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:01:09,099 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-27 04:01:09,102 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 04:01:09,298 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:09,298 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:09,706 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0002_000001 (auth:SIMPLE) 2023-09-27 04:01:14,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0002_000001 (auth:SIMPLE) 2023-09-27 04:01:16,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0002_000001 (auth:SIMPLE) 2023-09-27 04:01:19,568 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0002_000001 (auth:SIMPLE) 2023-09-27 04:01:21,564 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:01:21,568 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:01:21,586 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-27 04:01:21,587 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:01:21,588 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:01:21,588 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 04:01:21,589 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 04:01:21,590 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 04:01:21,590 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 04:01:21,591 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 04:01:21,591 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787267039/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 04:01:21,623 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-27 04:01:21,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-09-27 04:01:21,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:21,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 04:01:21,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787281637"}]},"ts":"1695787281637"} 2023-09-27 04:01:21,639 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 04:01:21,640 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-27 04:01:21,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, UNASSIGN}] 2023-09-27 04:01:21,645 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, UNASSIGN 2023-09-27 04:01:21,645 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, UNASSIGN 2023-09-27 04:01:21,648 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fc894930ce26e8b402dd7783110eaf54, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:21,648 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787281648"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787281648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787281648"}]},"ts":"1695787281648"} 2023-09-27 04:01:21,648 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3a333d503f88e9af39de7dcfd74adf14, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:21,649 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787281648"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787281648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787281648"}]},"ts":"1695787281648"} 2023-09-27 04:01:21,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure fc894930ce26e8b402dd7783110eaf54, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:01:21,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 3a333d503f88e9af39de7dcfd74adf14, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:21,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 04:01:21,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:21,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:21,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fc894930ce26e8b402dd7783110eaf54, disabling compactions & flushes 2023-09-27 04:01:21,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:21,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:21,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. after waiting 0 ms 2023-09-27 04:01:21,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:21,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3a333d503f88e9af39de7dcfd74adf14, disabling compactions & flushes 2023-09-27 04:01:21,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:21,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:21,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. after waiting 0 ms 2023-09-27 04:01:21,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:21,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:01:21,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:01:21,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:21,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:21,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14. 2023-09-27 04:01:21,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3a333d503f88e9af39de7dcfd74adf14: 2023-09-27 04:01:21,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54. 2023-09-27 04:01:21,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fc894930ce26e8b402dd7783110eaf54: 2023-09-27 04:01:21,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:21,845 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3a333d503f88e9af39de7dcfd74adf14, regionState=CLOSED 2023-09-27 04:01:21,845 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787281845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787281845"}]},"ts":"1695787281845"} 2023-09-27 04:01:21,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:21,851 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fc894930ce26e8b402dd7783110eaf54, regionState=CLOSED 2023-09-27 04:01:21,851 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695787281851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787281851"}]},"ts":"1695787281851"} 2023-09-27 04:01:21,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-27 04:01:21,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure fc894930ce26e8b402dd7783110eaf54, server=jenkins-hbase17.apache.org,44775,1695787230832 in 206 msec 2023-09-27 04:01:21,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-27 04:01:21,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 3a333d503f88e9af39de7dcfd74adf14, server=jenkins-hbase17.apache.org,38525,1695787230747 in 206 msec 2023-09-27 04:01:21,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fc894930ce26e8b402dd7783110eaf54, UNASSIGN in 220 msec 2023-09-27 04:01:21,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-27 04:01:21,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3a333d503f88e9af39de7dcfd74adf14, UNASSIGN in 221 msec 2023-09-27 04:01:21,868 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787281867"}]},"ts":"1695787281867"} 2023-09-27 04:01:21,871 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 04:01:21,873 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-27 04:01:21,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 251 msec 2023-09-27 04:01:21,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 04:01:21,939 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-27 04:01:21,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-09-27 04:01:21,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:21,944 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:21,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-27 04:01:21,945 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:21,947 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-27 04:01:21,949 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,949 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,949 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,950 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 04:01:21,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 04:01:21,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 04:01:21,950 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 04:01:21,951 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:21,952 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:21,952 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:21,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 04:01:21,954 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/recovered.edits] 2023-09-27 04:01:21,954 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/recovered.edits] 2023-09-27 04:01:21,958 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf/cc715f013e3641b9a51f5669935b6840 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/cf/cc715f013e3641b9a51f5669935b6840 2023-09-27 04:01:21,958 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf/0abcb8fc0a7143efb9876be88601d343 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/cf/0abcb8fc0a7143efb9876be88601d343 2023-09-27 04:01:21,961 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54/recovered.edits/9.seqid 2023-09-27 04:01:21,961 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14/recovered.edits/9.seqid 2023-09-27 04:01:21,962 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/3a333d503f88e9af39de7dcfd74adf14 2023-09-27 04:01:21,962 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemState/fc894930ce26e8b402dd7783110eaf54 2023-09-27 04:01:21,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 04:01:21,962 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 04:01:21,963 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-27 04:01:21,968 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927273bd8c6c672486c8a858d359b38bff3 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927273bd8c6c672486c8a858d359b38bff3 2023-09-27 04:01:21,970 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927545677c3baa44474a760816a4804d083 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230927545677c3baa44474a760816a4804d083 2023-09-27 04:01:21,971 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 04:01:21,974 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:21,990 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-27 04:01:21,998 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-27 04:01:22,000 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:22,000 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-27 04:01:22,000 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787282000"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:22,001 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787282000"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:22,016 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 04:01:22,016 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fc894930ce26e8b402dd7783110eaf54, NAME => 'testtb-testExportFileSystemState,,1695787263483.fc894930ce26e8b402dd7783110eaf54.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3a333d503f88e9af39de7dcfd74adf14, NAME => 'testtb-testExportFileSystemState,1,1695787263483.3a333d503f88e9af39de7dcfd74adf14.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 04:01:22,016 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-27 04:01:22,016 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787282016"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:22,018 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-27 04:01:22,021 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 04:01:22,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 81 msec 2023-09-27 04:01:22,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 04:01:22,054 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-27 04:01:22,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-27 04:01:22,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-27 04:01:22,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-09-27 04:01:22,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-27 04:01:22,100 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 757) Potentially hanging thread: hconnection-0x198566fb-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:36942 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:46513 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:38880 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:35550 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2082 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x198566fb-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1931288619_1 at /127.0.0.1:37898 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=602 (was 629), ProcessCount=182 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=943 (was 1219) 2023-09-27 04:01:22,100 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-27 04:01:22,121 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=602, ProcessCount=182, AvailableMemoryMB=942 2023-09-27 04:01:22,121 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-27 04:01:22,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 04:01:22,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:22,126 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:01:22,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-27 04:01:22,127 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:01:22,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 04:01:22,130 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,130 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,131 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 empty. 2023-09-27 04:01:22,131 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c empty. 2023-09-27 04:01:22,131 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,131 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 04:01:22,148 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-27 04:01:22,151 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 40e29373e96fe9ca8f6b6da138585cd8, NAME => 'testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:22,151 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 01c1d148337cc8007470a196686d682c, NAME => 'testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:22,166 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:22,166 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 01c1d148337cc8007470a196686d682c, disabling compactions & flushes 2023-09-27 04:01:22,166 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,166 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,166 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. after waiting 0 ms 2023-09-27 04:01:22,166 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,166 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,166 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 01c1d148337cc8007470a196686d682c: 2023-09-27 04:01:22,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:22,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 40e29373e96fe9ca8f6b6da138585cd8, disabling compactions & flushes 2023-09-27 04:01:22,167 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. after waiting 0 ms 2023-09-27 04:01:22,167 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,168 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,168 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 40e29373e96fe9ca8f6b6da138585cd8: 2023-09-27 04:01:22,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:01:22,171 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787282171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787282171"}]},"ts":"1695787282171"} 2023-09-27 04:01:22,171 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787282171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787282171"}]},"ts":"1695787282171"} 2023-09-27 04:01:22,173 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:01:22,174 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:01:22,175 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787282175"}]},"ts":"1695787282175"} 2023-09-27 04:01:22,177 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-27 04:01:22,179 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:01:22,180 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:01:22,180 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:01:22,181 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:01:22,181 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:01:22,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, ASSIGN}] 2023-09-27 04:01:22,184 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, ASSIGN 2023-09-27 04:01:22,184 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, ASSIGN 2023-09-27 04:01:22,187 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36187,1695787230796; forceNewPlan=false, retain=false 2023-09-27 04:01:22,187 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:01:22,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 04:01:22,337 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:01:22,340 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=40e29373e96fe9ca8f6b6da138585cd8, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=01c1d148337cc8007470a196686d682c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787282340"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787282340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787282340"}]},"ts":"1695787282340"} 2023-09-27 04:01:22,340 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787282340"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787282340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787282340"}]},"ts":"1695787282340"} 2023-09-27 04:01:22,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 40e29373e96fe9ca8f6b6da138585cd8, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:22,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 01c1d148337cc8007470a196686d682c, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:01:22,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 04:01:22,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40e29373e96fe9ca8f6b6da138585cd8, NAME => 'testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 04:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. service=AccessControlService 2023-09-27 04:01:22,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01c1d148337cc8007470a196686d682c, NAME => 'testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 04:01:22,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. service=AccessControlService 2023-09-27 04:01:22,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,529 INFO [StoreOpener-40e29373e96fe9ca8f6b6da138585cd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,533 INFO [StoreOpener-01c1d148337cc8007470a196686d682c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,534 DEBUG [StoreOpener-40e29373e96fe9ca8f6b6da138585cd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf 2023-09-27 04:01:22,535 DEBUG [StoreOpener-40e29373e96fe9ca8f6b6da138585cd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf 2023-09-27 04:01:22,535 INFO [StoreOpener-40e29373e96fe9ca8f6b6da138585cd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40e29373e96fe9ca8f6b6da138585cd8 columnFamilyName cf 2023-09-27 04:01:22,536 DEBUG [StoreOpener-01c1d148337cc8007470a196686d682c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf 2023-09-27 04:01:22,536 DEBUG [StoreOpener-01c1d148337cc8007470a196686d682c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf 2023-09-27 04:01:22,538 INFO [StoreOpener-01c1d148337cc8007470a196686d682c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01c1d148337cc8007470a196686d682c columnFamilyName cf 2023-09-27 04:01:22,538 INFO [StoreOpener-40e29373e96fe9ca8f6b6da138585cd8-1] regionserver.HStore(310): Store=40e29373e96fe9ca8f6b6da138585cd8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:22,539 INFO [StoreOpener-01c1d148337cc8007470a196686d682c-1] regionserver.HStore(310): Store=01c1d148337cc8007470a196686d682c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:22,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:22,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:22,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:22,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 40e29373e96fe9ca8f6b6da138585cd8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72334804, jitterRate=0.07787257432937622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:22,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 40e29373e96fe9ca8f6b6da138585cd8: 2023-09-27 04:01:22,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8., pid=45, masterSystemTime=1695787282495 2023-09-27 04:01:22,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:22,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 01c1d148337cc8007470a196686d682c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65766020, jitterRate=-0.020009934902191162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:22,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 01c1d148337cc8007470a196686d682c: 2023-09-27 04:01:22,573 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=40e29373e96fe9ca8f6b6da138585cd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787282572"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787282572"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787282572"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787282572"}]},"ts":"1695787282572"} 2023-09-27 04:01:22,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c., pid=46, masterSystemTime=1695787282498 2023-09-27 04:01:22,580 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=01c1d148337cc8007470a196686d682c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,581 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787282580"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787282580"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787282580"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787282580"}]},"ts":"1695787282580"} 2023-09-27 04:01:22,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-27 04:01:22,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 40e29373e96fe9ca8f6b6da138585cd8, server=jenkins-hbase17.apache.org,38525,1695787230747 in 234 msec 2023-09-27 04:01:22,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,588 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, ASSIGN in 401 msec 2023-09-27 04:01:22,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-27 04:01:22,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 01c1d148337cc8007470a196686d682c, server=jenkins-hbase17.apache.org,36187,1695787230796 in 239 msec 2023-09-27 04:01:22,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-27 04:01:22,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, ASSIGN in 409 msec 2023-09-27 04:01:22,613 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:01:22,613 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787282613"}]},"ts":"1695787282613"} 2023-09-27 04:01:22,615 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-27 04:01:22,618 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:01:22,618 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-27 04:01:22,621 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 04:01:22,623 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:22,623 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:22,623 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:22,623 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:22,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:22,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:22,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:22,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:22,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 502 msec 2023-09-27 04:01:22,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 04:01:22,734 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-27 04:01:22,741 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 04:01:22,742 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,743 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:01:22,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 04:01:22,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787282763 (current time:1695787282763). 2023-09-27 04:01:22,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:22,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x1053b203 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:22,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b4155a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:22,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:22,808 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:22,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1053b203 to 127.0.0.1:51909 2023-09-27 04:01:22,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:22,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x73339c5b to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:22,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7efdeb94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:22,831 DEBUG [hconnection-0x7f107d88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:22,835 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:22,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:22,844 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73339c5b to 127.0.0.1:51909 2023-09-27 04:01:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:22,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 04:01:22,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:22,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 04:01:22,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 04:01:22,852 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 04:01:22,853 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695787882853 2023-09-27 04:01:22,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 04:01:22,853 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 04:01:22,854 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:22,856 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:22,861 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 04:01:22,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 04:01:22,863 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-09-27 04:01:22,865 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 04:01:22,866 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695787882866 2023-09-27 04:01:22,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,892 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-27 04:01:22,892 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:22,894 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 04:01:22,895 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 04:01:22,897 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,897 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,898 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:22,898 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:22,898 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:22,898 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:22,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:22,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:22,899 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,899 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:22,899 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,899 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 04:01:22,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 04:01:22,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,901 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 04:01:22,901 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:22,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 04:01:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 04:01:22,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 04:01:22,908 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 04:01:22,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,908 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:22,908 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 04:01:22,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 04:01:22,910 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,910 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:22,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:22,910 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,911 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:22,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:22,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:22,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:22,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,915 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 04:01:22,915 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 04:01:22,915 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 04:01:22,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 04:01:22,916 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 04:01:22,915 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:22,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a5b4938[Count = 1] remaining members to acquire global barrier 2023-09-27 04:01:22,920 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 04:01:22,920 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 04:01:22,921 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 04:01:22,922 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,922 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,922 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:22,926 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,926 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:22,927 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,927 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:22,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 04:01:22,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a5b4938[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:22,935 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 04:01:22,935 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,938 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 04:01:22,938 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 04:01:22,938 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:22,938 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 04:01:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,939 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 04:01:22,939 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:22,940 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 04:01:22,940 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:22,940 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 04:01:22,941 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:22,941 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:22,947 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:22,961 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:22,961 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:22,961 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:22,961 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:22,962 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:22,956 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:22,962 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. started... 2023-09-27 04:01:22,962 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40e29373e96fe9ca8f6b6da138585cd8: 2023-09-27 04:01:22,963 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,963 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:22,963 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:01:22,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 04:01:22,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:22,964 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:01:22,962 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. started... 2023-09-27 04:01:22,971 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 01c1d148337cc8007470a196686d682c: 2023-09-27 04:01:22,971 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:22,972 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:22,972 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:01:23,041 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. completed. 2023-09-27 04:01:23,041 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:23,042 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:23,042 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:23,042 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,042 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 04:01:23,042 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:23,044 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,045 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 04:01:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,045 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,046 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 04:01:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,083 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. completed. 2023-09-27 04:01:23,083 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:23,083 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:23,083 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:23,083 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,083 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 04:01:23,083 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:01:23,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 04:01:23,086 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,086 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 04:01:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,086 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,086 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 04:01:23,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,36187,1695787230796': 2023-09-27 04:01:23,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 04:01:23,096 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-27 04:01:23,096 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:23,096 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:23,096 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,096 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:23,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,100 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,101 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,105 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,105 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,106 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,112 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 04:01:23,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:01:23,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-09-27 04:01:23,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 04:01:23,164 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:23,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 04:01:23,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:23,166 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 04:01:23,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 04:01:23,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,312 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:23,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695787282854Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695787283193 (+339 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695787283193Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695787283193Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695787283225 (+32 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695787283289 (+64 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695787283311 (+22 ms) 2023-09-27 04:01:23,316 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 04:01:23,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 461 msec 2023-09-27 04:01:23,467 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:23,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 04:01:23,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:23,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38525] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:01:23,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36187] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:01:23,483 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 04:01:23,483 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:23,483 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:01:23,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 04:01:23,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787283499 (current time:1695787283499). 2023-09-27 04:01:23,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:23,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x179944b8 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:23,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@96105ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:23,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:23,518 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:23,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x179944b8 to 127.0.0.1:51909 2023-09-27 04:01:23,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:23,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x73f8ebd4 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:23,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e19cd97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:23,535 DEBUG [hconnection-0x2fd4f19d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:23,539 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:23,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:23,549 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:23,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73f8ebd4 to 127.0.0.1:51909 2023-09-27 04:01:23,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:23,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 04:01:23,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:23,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 04:01:23,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 04:01:23,557 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 04:01:23,558 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695787883558 2023-09-27 04:01:23,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 04:01:23,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 04:01:23,560 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:23,560 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:23,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 04:01:23,563 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 04:01:23,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-27 04:01:23,568 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 04:01:23,573 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695787883573 2023-09-27 04:01:23,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-27 04:01:23,592 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-27 04:01:23,593 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:23,594 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 04:01:23,594 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 04:01:23,595 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,595 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,596 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,596 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,596 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,596 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,596 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,596 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,597 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,597 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,598 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 04:01:23,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 04:01:23,599 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 04:01:23,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 04:01:23,599 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:23,599 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 04:01:23,599 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:23,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 04:01:23,605 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 04:01:23,607 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 04:01:23,607 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 04:01:23,607 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 04:01:23,608 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,609 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,609 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:23,609 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,610 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509105ef[Count = 1] remaining members to acquire global barrier 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 04:01:23,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509105ef[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:23,613 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 04:01:23,613 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,614 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,615 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 04:01:23,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,615 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 04:01:23,615 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,615 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,615 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:23,617 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 04:01:23,617 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:23,617 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:23,617 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:23,617 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 04:01:23,617 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. started... 2023-09-27 04:01:23,617 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:23,618 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:23,618 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:23,618 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:23,619 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. started... 2023-09-27 04:01:23,619 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 04:01:23,619 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,619 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 04:01:23,620 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 40e29373e96fe9ca8f6b6da138585cd8 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-27 04:01:23,627 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 01c1d148337cc8007470a196686d682c 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-27 04:01:23,663 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:23,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 04:01:23,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:23,665 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:01:23,681 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092774400011f32b41698df861f9156982ef to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092774400011f32b41698df861f9156982ef 2023-09-27 04:01:23,690 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927f1ea50c892db4d57a5cd1451f133f89a to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f1ea50c892db4d57a5cd1451f133f89a 2023-09-27 04:01:23,704 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/.tmp/cf/eef7f2439f6e48e9845d011bc47bdcd5 2023-09-27 04:01:23,705 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/.tmp/cf/95903baec12641aba4453fda98d711c9 2023-09-27 04:01:23,710 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/.tmp/cf/eef7f2439f6e48e9845d011bc47bdcd5 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf/eef7f2439f6e48e9845d011bc47bdcd5 2023-09-27 04:01:23,710 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/.tmp/cf/95903baec12641aba4453fda98d711c9 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf/95903baec12641aba4453fda98d711c9 2023-09-27 04:01:23,718 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf/eef7f2439f6e48e9845d011bc47bdcd5, entries=45, sequenceid=6, filesize=12.4 K 2023-09-27 04:01:23,719 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 01c1d148337cc8007470a196686d682c in 93ms, sequenceid=6, compaction requested=false 2023-09-27 04:01:23,720 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-27 04:01:23,720 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 01c1d148337cc8007470a196686d682c: 2023-09-27 04:01:23,720 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 04:01:23,721 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:23,721 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf/eef7f2439f6e48e9845d011bc47bdcd5] hfiles 2023-09-27 04:01:23,721 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf/eef7f2439f6e48e9845d011bc47bdcd5 for snapshot=snaptb0-testConsecutiveExports 2023-09-27 04:01:23,721 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf/95903baec12641aba4453fda98d711c9, entries=5, sequenceid=6, filesize=5.7 K 2023-09-27 04:01:23,722 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 40e29373e96fe9ca8f6b6da138585cd8 in 102ms, sequenceid=6, compaction requested=false 2023-09-27 04:01:23,724 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40e29373e96fe9ca8f6b6da138585cd8: 2023-09-27 04:01:23,725 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 04:01:23,725 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:23,725 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf/95903baec12641aba4453fda98d711c9] hfiles 2023-09-27 04:01:23,725 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf/95903baec12641aba4453fda98d711c9 for snapshot=snaptb0-testConsecutiveExports 2023-09-27 04:01:23,739 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. completed. 2023-09-27 04:01:23,739 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:23,739 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:23,739 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:23,739 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,739 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 04:01:23,739 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:23,740 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,740 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 04:01:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,740 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,741 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. completed. 2023-09-27 04:01:23,741 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 04:01:23,742 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:23,742 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:23,742 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,742 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,742 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 04:01:23,742 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,743 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,743 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 04:01:23,743 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,744 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 04:01:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,36187,1695787230796': 2023-09-27 04:01:23,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 04:01:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:01:23,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 04:01:23,754 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-27 04:01:23,755 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:23,755 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:23,755 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-27 04:01:23,755 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,757 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,759 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,759 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:23,761 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 04:01:23,761 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,762 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,765 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,765 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,765 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-27 04:01:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 04:01:23,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,766 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:23,766 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:23,767 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 04:01:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:23,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:01:23,767 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:23,768 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:23,768 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,768 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092774400011f32b41698df861f9156982ef, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f1ea50c892db4d57a5cd1451f133f89a] mob files 2023-09-27 04:01:23,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092774400011f32b41698df861f9156982ef 2023-09-27 04:01:23,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f1ea50c892db4d57a5cd1451f133f89a 2023-09-27 04:01:23,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-27 04:01:23,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 04:01:23,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,811 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695787283558Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695787283778 (+220 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695787283778Loading Region manifests for snaptb0-testConsecutiveExports at 1695787283778Writing data manifest for snaptb0-testConsecutiveExports at 1695787283781 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695787283802 (+21 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695787283811 (+9 ms) 2023-09-27 04:01:23,814 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 04:01:23,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 254 msec 2023-09-27 04:01:23,865 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:23,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 04:01:23,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:23,867 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867 2023-09-27 04:01:23,867 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:23,886 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:23,886 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@987547d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,886 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 04:01:23,894 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:23,907 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:23,908 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:23,908 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:23,909 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,753 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-8095404237621280358.jar 2023-09-27 04:01:24,753 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,754 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,810 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-5850363258852240063.jar 2023-09-27 04:01:24,810 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,811 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,811 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,811 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,812 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,812 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:24,812 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:01:24,813 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:01:24,813 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:01:24,813 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:01:24,814 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:01:24,814 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:01:24,814 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:01:24,815 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:01:24,815 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:01:24,815 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:01:24,816 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:24,816 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:24,817 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:24,817 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:24,817 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:24,818 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:24,818 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:25,362 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:01:25,364 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 04:01:25,367 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 04:01:25,686 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:25,687 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:25,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0002_000001 (auth:SIMPLE) 2023-09-27 04:01:25,928 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0003_000001 (auth:SIMPLE) 2023-09-27 04:01:27,430 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:01:30,058 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0003_000001 (auth:SIMPLE) 2023-09-27 04:01:32,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0003_000001 (auth:SIMPLE) 2023-09-27 04:01:35,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0003_000001 (auth:SIMPLE) 2023-09-27 04:01:36,579 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:01:36,580 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:01:36,584 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 04:01:36,584 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:01:36,585 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:01:36,585 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 04:01:36,587 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 04:01:36,588 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 04:01:36,588 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5039130a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 04:01:36,588 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 04:01:36,588 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 04:01:36,589 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:36,609 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:36,609 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1ffd01, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:36,609 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 04:01:36,618 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 04:01:36,629 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:36,629 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:36,630 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:36,630 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,435 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-2213605409545325239.jar 2023-09-27 04:01:37,435 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,436 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,506 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-4159983845619244831.jar 2023-09-27 04:01:37,507 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,507 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,508 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,508 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,508 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,508 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:37,509 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:01:37,509 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:01:37,510 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:01:37,510 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:01:37,510 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:01:37,511 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:01:37,511 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:01:37,511 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:01:37,511 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:01:37,512 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:01:37,512 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:37,513 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:37,513 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:37,514 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:37,514 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:37,515 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:37,516 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:38,750 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:01:38,753 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 04:01:38,755 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 04:01:41,620 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:41,620 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:41,623 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0003_000001 (auth:SIMPLE) 2023-09-27 04:01:42,424 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0004_000001 (auth:SIMPLE) 2023-09-27 04:01:46,266 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0004_000001 (auth:SIMPLE) 2023-09-27 04:01:48,465 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0004_000001 (auth:SIMPLE) 2023-09-27 04:01:50,539 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0004_000001 (auth:SIMPLE) 2023-09-27 04:01:52,343 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:01:52,343 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:01:52,347 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 04:01:52,347 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:01:52,347 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:01:52,348 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 04:01:52,351 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 04:01:52,351 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 04:01:52,351 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5039130a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 04:01:52,351 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 04:01:52,351 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/local-export-1695787283867/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 04:01:52,362 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-27 04:01:52,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-09-27 04:01:52,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 04:01:52,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787312367"}]},"ts":"1695787312367"} 2023-09-27 04:01:52,369 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-27 04:01:52,370 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-27 04:01:52,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, UNASSIGN}] 2023-09-27 04:01:52,374 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, UNASSIGN 2023-09-27 04:01:52,374 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, UNASSIGN 2023-09-27 04:01:52,375 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=01c1d148337cc8007470a196686d682c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:52,375 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=40e29373e96fe9ca8f6b6da138585cd8, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:52,375 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787312375"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787312375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787312375"}]},"ts":"1695787312375"} 2023-09-27 04:01:52,376 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787312375"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787312375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787312375"}]},"ts":"1695787312375"} 2023-09-27 04:01:52,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 01c1d148337cc8007470a196686d682c, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:01:52,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 40e29373e96fe9ca8f6b6da138585cd8, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:52,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 04:01:52,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:52,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 01c1d148337cc8007470a196686d682c, disabling compactions & flushes 2023-09-27 04:01:52,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:52,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:52,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. after waiting 0 ms 2023-09-27 04:01:52,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:52,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:52,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 40e29373e96fe9ca8f6b6da138585cd8, disabling compactions & flushes 2023-09-27 04:01:52,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:52,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:52,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. after waiting 0 ms 2023-09-27 04:01:52,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:52,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:01:52,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:01:52,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:52,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:52,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8. 2023-09-27 04:01:52,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c. 2023-09-27 04:01:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 40e29373e96fe9ca8f6b6da138585cd8: 2023-09-27 04:01:52,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 01c1d148337cc8007470a196686d682c: 2023-09-27 04:01:52,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 01c1d148337cc8007470a196686d682c 2023-09-27 04:01:52,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=01c1d148337cc8007470a196686d682c, regionState=CLOSED 2023-09-27 04:01:52,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:52,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787312561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787312561"}]},"ts":"1695787312561"} 2023-09-27 04:01:52,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=40e29373e96fe9ca8f6b6da138585cd8, regionState=CLOSED 2023-09-27 04:01:52,562 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695787312562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787312562"}]},"ts":"1695787312562"} 2023-09-27 04:01:52,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-27 04:01:52,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 01c1d148337cc8007470a196686d682c, server=jenkins-hbase17.apache.org,36187,1695787230796 in 186 msec 2023-09-27 04:01:52,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-27 04:01:52,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 40e29373e96fe9ca8f6b6da138585cd8, server=jenkins-hbase17.apache.org,38525,1695787230747 in 185 msec 2023-09-27 04:01:52,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=01c1d148337cc8007470a196686d682c, UNASSIGN in 193 msec 2023-09-27 04:01:52,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-27 04:01:52,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=40e29373e96fe9ca8f6b6da138585cd8, UNASSIGN in 194 msec 2023-09-27 04:01:52,568 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787312568"}]},"ts":"1695787312568"} 2023-09-27 04:01:52,575 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-27 04:01:52,576 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-27 04:01:52,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 215 msec 2023-09-27 04:01:52,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 04:01:52,670 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-27 04:01:52,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-09-27 04:01:52,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,674 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-27 04:01:52,675 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,679 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-27 04:01:52,682 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 04:01:52,682 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 04:01:52,682 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 04:01:52,682 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 04:01:52,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 04:01:52,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 04:01:52,683 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:52,683 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 04:01:52,683 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:52,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-27 04:01:52,683 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-27 04:01:52,683 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 04:01:52,683 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 04:01:52,683 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:52,683 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:52,683 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:52,683 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 04:01:52,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 04:01:52,689 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c 2023-09-27 04:01:52,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/recovered.edits] 2023-09-27 04:01:52,691 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/recovered.edits] 2023-09-27 04:01:52,695 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf/eef7f2439f6e48e9845d011bc47bdcd5 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/cf/eef7f2439f6e48e9845d011bc47bdcd5 2023-09-27 04:01:52,695 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf/95903baec12641aba4453fda98d711c9 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/cf/95903baec12641aba4453fda98d711c9 2023-09-27 04:01:52,699 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c/recovered.edits/9.seqid 2023-09-27 04:01:52,699 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8/recovered.edits/9.seqid 2023-09-27 04:01:52,709 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/01c1d148337cc8007470a196686d682c 2023-09-27 04:01:52,709 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testConsecutiveExports/40e29373e96fe9ca8f6b6da138585cd8 2023-09-27 04:01:52,709 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 04:01:52,710 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 04:01:52,711 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-27 04:01:52,716 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092774400011f32b41698df861f9156982ef to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023092774400011f32b41698df861f9156982ef 2023-09-27 04:01:52,718 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f1ea50c892db4d57a5cd1451f133f89a to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927f1ea50c892db4d57a5cd1451f133f89a 2023-09-27 04:01:52,719 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 04:01:52,722 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,726 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-27 04:01:52,731 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-27 04:01:52,734 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,734 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-27 04:01:52,734 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787312734"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:52,734 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787312734"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:52,739 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 04:01:52,739 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 40e29373e96fe9ca8f6b6da138585cd8, NAME => 'testtb-testConsecutiveExports,,1695787282122.40e29373e96fe9ca8f6b6da138585cd8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 01c1d148337cc8007470a196686d682c, NAME => 'testtb-testConsecutiveExports,1,1695787282122.01c1d148337cc8007470a196686d682c.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 04:01:52,740 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-27 04:01:52,740 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787312740"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:52,742 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-27 04:01:52,745 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 04:01:52,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 74 msec 2023-09-27 04:01:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 04:01:52,787 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-27 04:01:52,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-27 04:01:52,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-27 04:01:52,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-09-27 04:01:52,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-27 04:01:52,829 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 763), OpenFileDescriptor=907 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=491 (was 602), ProcessCount=171 (was 182), AvailableMemoryMB=3051 (was 942) - AvailableMemoryMB LEAK? - 2023-09-27 04:01:52,829 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-27 04:01:52,850 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=491, ProcessCount=171, AvailableMemoryMB=3050 2023-09-27 04:01:52,850 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-27 04:01:52,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 04:01:52,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:52,856 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:01:52,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-27 04:01:52,857 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:01:52,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 04:01:52,859 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:52,859 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:52,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 empty. 2023-09-27 04:01:52,860 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 empty. 2023-09-27 04:01:52,860 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:52,860 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:52,860 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 04:01:52,871 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-27 04:01:52,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c95eed1f97f3191e0ff1dda09def4e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:52,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0f0b42f1b0a45932a6f6ba8cb5e8de71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:52,888 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:52,889 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9c95eed1f97f3191e0ff1dda09def4e5, disabling compactions & flushes 2023-09-27 04:01:52,889 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:52,889 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:52,889 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. after waiting 0 ms 2023-09-27 04:01:52,889 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:52,889 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:52,889 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9c95eed1f97f3191e0ff1dda09def4e5: 2023-09-27 04:01:52,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:52,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0f0b42f1b0a45932a6f6ba8cb5e8de71, disabling compactions & flushes 2023-09-27 04:01:52,891 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:52,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:52,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. after waiting 0 ms 2023-09-27 04:01:52,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:52,891 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:52,891 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0f0b42f1b0a45932a6f6ba8cb5e8de71: 2023-09-27 04:01:52,894 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:01:52,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787312895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787312895"}]},"ts":"1695787312895"} 2023-09-27 04:01:52,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787312895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787312895"}]},"ts":"1695787312895"} 2023-09-27 04:01:52,901 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:01:52,902 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:01:52,903 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787312902"}]},"ts":"1695787312902"} 2023-09-27 04:01:52,904 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-27 04:01:52,906 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:01:52,907 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:01:52,908 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:01:52,908 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:01:52,908 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:01:52,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, ASSIGN}] 2023-09-27 04:01:52,911 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, ASSIGN 2023-09-27 04:01:52,911 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, ASSIGN 2023-09-27 04:01:52,912 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44775,1695787230832; forceNewPlan=false, retain=false 2023-09-27 04:01:52,912 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:01:52,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 04:01:53,062 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:01:53,064 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0f0b42f1b0a45932a6f6ba8cb5e8de71, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,064 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9c95eed1f97f3191e0ff1dda09def4e5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,064 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787313064"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787313064"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787313064"}]},"ts":"1695787313064"} 2023-09-27 04:01:53,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787313064"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787313064"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787313064"}]},"ts":"1695787313064"} 2023-09-27 04:01:53,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 0f0b42f1b0a45932a6f6ba8cb5e8de71, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:01:53,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 9c95eed1f97f3191e0ff1dda09def4e5, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:53,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 04:01:53,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:53,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c95eed1f97f3191e0ff1dda09def4e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 04:01:53,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f0b42f1b0a45932a6f6ba8cb5e8de71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. service=AccessControlService 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. service=AccessControlService 2023-09-27 04:01:53,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:53,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,232 INFO [StoreOpener-0f0b42f1b0a45932a6f6ba8cb5e8de71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,232 INFO [StoreOpener-9c95eed1f97f3191e0ff1dda09def4e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,234 DEBUG [StoreOpener-0f0b42f1b0a45932a6f6ba8cb5e8de71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf 2023-09-27 04:01:53,234 DEBUG [StoreOpener-0f0b42f1b0a45932a6f6ba8cb5e8de71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf 2023-09-27 04:01:53,234 DEBUG [StoreOpener-9c95eed1f97f3191e0ff1dda09def4e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf 2023-09-27 04:01:53,234 DEBUG [StoreOpener-9c95eed1f97f3191e0ff1dda09def4e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf 2023-09-27 04:01:53,235 INFO [StoreOpener-9c95eed1f97f3191e0ff1dda09def4e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c95eed1f97f3191e0ff1dda09def4e5 columnFamilyName cf 2023-09-27 04:01:53,235 INFO [StoreOpener-0f0b42f1b0a45932a6f6ba8cb5e8de71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f0b42f1b0a45932a6f6ba8cb5e8de71 columnFamilyName cf 2023-09-27 04:01:53,237 INFO [StoreOpener-9c95eed1f97f3191e0ff1dda09def4e5-1] regionserver.HStore(310): Store=9c95eed1f97f3191e0ff1dda09def4e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:53,237 INFO [StoreOpener-0f0b42f1b0a45932a6f6ba8cb5e8de71-1] regionserver.HStore(310): Store=0f0b42f1b0a45932a6f6ba8cb5e8de71/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:53,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:01:53,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:01:53,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:53,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:53,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0f0b42f1b0a45932a6f6ba8cb5e8de71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65157150, jitterRate=-0.029082804918289185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:53,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0f0b42f1b0a45932a6f6ba8cb5e8de71: 2023-09-27 04:01:53,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9c95eed1f97f3191e0ff1dda09def4e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75090654, jitterRate=0.11893793940544128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:53,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9c95eed1f97f3191e0ff1dda09def4e5: 2023-09-27 04:01:53,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5., pid=61, masterSystemTime=1695787313226 2023-09-27 04:01:53,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9c95eed1f97f3191e0ff1dda09def4e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,256 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787313256"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787313256"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787313256"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787313256"}]},"ts":"1695787313256"} 2023-09-27 04:01:53,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-27 04:01:53,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 9c95eed1f97f3191e0ff1dda09def4e5, server=jenkins-hbase17.apache.org,38525,1695787230747 in 185 msec 2023-09-27 04:01:53,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, ASSIGN in 353 msec 2023-09-27 04:01:53,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71., pid=60, masterSystemTime=1695787313223 2023-09-27 04:01:53,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:53,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:53,266 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0f0b42f1b0a45932a6f6ba8cb5e8de71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,266 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787313265"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787313265"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787313265"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787313265"}]},"ts":"1695787313265"} 2023-09-27 04:01:53,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-27 04:01:53,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 0f0b42f1b0a45932a6f6ba8cb5e8de71, server=jenkins-hbase17.apache.org,44775,1695787230832 in 201 msec 2023-09-27 04:01:53,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-27 04:01:53,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, ASSIGN in 361 msec 2023-09-27 04:01:53,273 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:01:53,273 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787313273"}]},"ts":"1695787313273"} 2023-09-27 04:01:53,275 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-27 04:01:53,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:01:53,278 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-27 04:01:53,280 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 04:01:53,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:53,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:53,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:53,281 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:53,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:53,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:53,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:53,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:53,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 430 msec 2023-09-27 04:01:53,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 04:01:53,461 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-27 04:01:53,463 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,463 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,465 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:01:53,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 04:01:53,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787313479 (current time:1695787313479). 2023-09-27 04:01:53,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:53,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x6bc1db4f to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:53,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d6e1144, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:53,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:53,493 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:53,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bc1db4f to 127.0.0.1:51909 2023-09-27 04:01:53,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:53,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x4fadff6e to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:53,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ad34e77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:53,507 DEBUG [hconnection-0x178a9e58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:53,510 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:53,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:53,521 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:53,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fadff6e to 127.0.0.1:51909 2023-09-27 04:01:53,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:53,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 04:01:53,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:53,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 04:01:53,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 04:01:53,528 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 04:01:53,529 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695787913529 2023-09-27 04:01:53,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 04:01:53,531 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:53,532 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:53,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 04:01:53,533 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 04:01:53,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-09-27 04:01:53,536 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 04:01:53,537 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695787913537 2023-09-27 04:01:53,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,550 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 04:01:53,550 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,552 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 04:01:53,552 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 04:01:53,553 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,553 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,554 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,554 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,554 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,554 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,555 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,556 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 04:01:53,556 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 04:01:53,556 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,556 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 04:01:53,557 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 04:01:53,558 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 04:01:53,557 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,556 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,559 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 04:01:53,558 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 04:01:53,560 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 04:01:53,560 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 04:01:53,560 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 04:01:53,560 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 04:01:53,560 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 04:01:53,561 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,562 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,562 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2bd460[Count = 1] remaining members to acquire global barrier 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 04:01:53,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2bd460[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:53,566 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 04:01:53,566 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,567 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 04:01:53,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:53,567 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,567 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 04:01:53,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:53,568 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,568 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:53,568 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,568 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:53,568 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:53,568 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. started... 2023-09-27 04:01:53,568 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. started... 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c95eed1f97f3191e0ff1dda09def4e5: 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f0b42f1b0a45932a6f6ba8cb5e8de71: 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:53,570 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:01:53,571 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 04:01:53,571 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:53,571 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 04:01:53,610 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. completed. 2023-09-27 04:01:53,611 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:53,611 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:53,611 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:53,611 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,611 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 04:01:53,611 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:53,612 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 04:01:53,612 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,612 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:53,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,612 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 04:01:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,616 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. completed. 2023-09-27 04:01:53,616 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,616 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:53,616 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,616 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,616 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 04:01:53,616 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,617 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 04:01:53,617 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,617 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:53,617 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 04:01:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:01:53,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 04:01:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:01:53,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 04:01:53,629 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 04:01:53,629 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:53,629 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:53,629 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,629 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,631 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:53,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:53,632 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,632 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 04:01:53,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:53,634 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:01:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,634 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,635 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,637 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,637 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,638 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,641 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:53,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:53,641 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,642 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:53,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:53,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:01:53,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:53,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:53,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:53,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 04:01:53,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 04:01:53,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,694 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695787313529Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695787313656 (+127 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695787313656Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695787313656Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695787313663 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695787313676 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695787313693 (+17 ms) 2023-09-27 04:01:53,701 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 04:01:53,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 170 msec 2023-09-27 04:01:53,834 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:53,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 04:01:53,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:53,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38525] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:01:53,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:01:53,844 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,844 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,845 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:01:53,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 04:01:53,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787313859 (current time:1695787313859). 2023-09-27 04:01:53,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:53,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x438d8950 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:53,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52edb4db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:53,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:53,875 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:53,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x438d8950 to 127.0.0.1:51909 2023-09-27 04:01:53,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:53,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x604b58cd to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:53,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fa38a9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:53,889 DEBUG [hconnection-0x7057b4de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:53,894 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:53,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:53,900 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x604b58cd to 127.0.0.1:51909 2023-09-27 04:01:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 04:01:53,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:53,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 04:01:53,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 04:01:53,907 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 04:01:53,908 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695787913908 2023-09-27 04:01:53,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 04:01:53,910 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:53,910 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:53,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 04:01:53,911 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 04:01:53,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-27 04:01:53,914 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 04:01:53,915 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695787913915 2023-09-27 04:01:53,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,931 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 04:01:53,931 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,932 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 04:01:53,932 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 04:01:53,933 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,933 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:53,934 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,934 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,934 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,935 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 04:01:53,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 04:01:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 04:01:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,936 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 04:01:53,936 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,937 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 04:01:53,937 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 04:01:53,936 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 04:01:53,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 04:01:53,937 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 04:01:53,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,938 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 04:01:53,938 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,939 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 04:01:53,939 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 04:01:53,939 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:53,939 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 04:01:53,940 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 04:01:53,941 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 04:01:53,941 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 04:01:53,941 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 04:01:53,942 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,942 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,942 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,942 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,943 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,943 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:53,943 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,943 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,943 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,943 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,943 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@588cae73[Count = 1] remaining members to acquire global barrier 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:53,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:53,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:53,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 04:01:53,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@588cae73[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:53,946 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 04:01:53,946 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 04:01:53,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 04:01:53,947 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 04:01:53,947 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:53,947 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. started... 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:53,947 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:53,947 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:53,947 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:53,947 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0f0b42f1b0a45932a6f6ba8cb5e8de71 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-27 04:01:53,948 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 04:01:53,948 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:53,948 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 04:01:53,949 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:53,953 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:53,953 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:53,953 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. started... 2023-09-27 04:01:53,953 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c95eed1f97f3191e0ff1dda09def4e5 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-27 04:01:53,997 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927f381122e0a9f4d0686bd3d2daf109ba9 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f381122e0a9f4d0686bd3d2daf109ba9 2023-09-27 04:01:53,998 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092791a2c1829d91467d91afcd48d005a573 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092791a2c1829d91467d91afcd48d005a573 2023-09-27 04:01:54,010 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:54,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 04:01:54,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:01:54,012 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:01:54,021 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/.tmp/cf/eabf53fbffc6485fb54a9159d2577fac 2023-09-27 04:01:54,024 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/.tmp/cf/6eb4dcd3eae3412893a7860d344d68d1 2023-09-27 04:01:54,028 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/.tmp/cf/eabf53fbffc6485fb54a9159d2577fac as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf/eabf53fbffc6485fb54a9159d2577fac 2023-09-27 04:01:54,030 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/.tmp/cf/6eb4dcd3eae3412893a7860d344d68d1 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf/6eb4dcd3eae3412893a7860d344d68d1 2023-09-27 04:01:54,035 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf/eabf53fbffc6485fb54a9159d2577fac, entries=47, sequenceid=6, filesize=13.5 K 2023-09-27 04:01:54,038 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf/6eb4dcd3eae3412893a7860d344d68d1, entries=3, sequenceid=6, filesize=5.4 K 2023-09-27 04:01:54,039 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9c95eed1f97f3191e0ff1dda09def4e5 in 86ms, sequenceid=6, compaction requested=false 2023-09-27 04:01:54,039 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-27 04:01:54,040 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c95eed1f97f3191e0ff1dda09def4e5: 2023-09-27 04:01:54,040 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,040 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:54,040 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf/6eb4dcd3eae3412893a7860d344d68d1] hfiles 2023-09-27 04:01:54,040 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf/6eb4dcd3eae3412893a7860d344d68d1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,045 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0f0b42f1b0a45932a6f6ba8cb5e8de71 in 98ms, sequenceid=6, compaction requested=false 2023-09-27 04:01:54,046 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0f0b42f1b0a45932a6f6ba8cb5e8de71: 2023-09-27 04:01:54,047 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,047 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:54,047 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf/eabf53fbffc6485fb54a9159d2577fac] hfiles 2023-09-27 04:01:54,047 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf/eabf53fbffc6485fb54a9159d2577fac for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,064 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. completed. 2023-09-27 04:01:54,064 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:01:54,064 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:54,064 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:54,064 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,066 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 04:01:54,066 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:54,068 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 04:01:54,068 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:54,068 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 04:01:54,070 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:54,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:54,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:54,072 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. completed. 2023-09-27 04:01:54,072 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:01:54,072 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:54,072 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:54,072 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,072 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 04:01:54,072 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,082 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 04:01:54,082 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,082 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,082 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 04:01:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:01:54,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 04:01:54,089 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 04:01:54,089 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:54,089 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:54,089 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,089 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:54,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:54,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:54,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:54,090 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,091 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:54,092 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,093 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,094 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,094 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:54,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:54,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:54,097 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:54,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:54,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:54,096 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:54,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:54,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:01:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:54,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092791a2c1829d91467d91afcd48d005a573, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f381122e0a9f4d0686bd3d2daf109ba9] mob files 2023-09-27 04:01:54,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092791a2c1829d91467d91afcd48d005a573 2023-09-27 04:01:54,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f381122e0a9f4d0686bd3d2daf109ba9 2023-09-27 04:01:54,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 04:01:54,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,151 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:01:54,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695787313908Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695787314113 (+205 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695787314113Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695787314113Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695787314117 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695787314142 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695787314151 (+9 ms) 2023-09-27 04:01:54,154 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 04:01:54,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 245 msec 2023-09-27 04:01:54,212 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:54,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 04:01:54,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:54,248 DEBUG [Listener at jenkins-hbase17.apache.org/37905] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 04:01:54,252 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 04:01:54,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36187] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 04:01:54,254 DEBUG [Listener at jenkins-hbase17.apache.org/37905] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 04:01:54,260 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 04:01:54,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38525] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 04:01:54,260 DEBUG [Listener at jenkins-hbase17.apache.org/37905] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 04:01:54,265 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 04:01:54,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44775] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 04:01:54,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 04:01:54,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:54,271 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:01:54,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-27 04:01:54,272 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:01:54,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 04:01:54,274 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,274 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,275 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb empty. 2023-09-27 04:01:54,275 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 empty. 2023-09-27 04:01:54,275 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,275 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,275 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 04:01:54,284 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-27 04:01:54,285 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 504793f6f02cfc3f492bdedca063c8a9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:54,285 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93181d90b38fb4e3cd919e44f835a7fb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 93181d90b38fb4e3cd919e44f835a7fb, disabling compactions & flushes 2023-09-27 04:01:54,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. after waiting 0 ms 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 93181d90b38fb4e3cd919e44f835a7fb: 2023-09-27 04:01:54,298 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:54,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 504793f6f02cfc3f492bdedca063c8a9, disabling compactions & flushes 2023-09-27 04:01:54,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. after waiting 0 ms 2023-09-27 04:01:54,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,299 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 504793f6f02cfc3f492bdedca063c8a9: 2023-09-27 04:01:54,301 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:01:54,302 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787314302"}]},"ts":"1695787314302"} 2023-09-27 04:01:54,302 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787314302"}]},"ts":"1695787314302"} 2023-09-27 04:01:54,304 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:01:54,304 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:01:54,305 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787314304"}]},"ts":"1695787314304"} 2023-09-27 04:01:54,306 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-27 04:01:54,308 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:01:54,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:01:54,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:01:54,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:01:54,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:01:54,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, ASSIGN}] 2023-09-27 04:01:54,312 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, ASSIGN 2023-09-27 04:01:54,312 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, ASSIGN 2023-09-27 04:01:54,312 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:01:54,313 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36187,1695787230796; forceNewPlan=false, retain=false 2023-09-27 04:01:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 04:01:54,463 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:01:54,466 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=504793f6f02cfc3f492bdedca063c8a9, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=93181d90b38fb4e3cd919e44f835a7fb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,467 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314466"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787314466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787314466"}]},"ts":"1695787314466"} 2023-09-27 04:01:54,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314466"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787314466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787314466"}]},"ts":"1695787314466"} 2023-09-27 04:01:54,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 93181d90b38fb4e3cd919e44f835a7fb, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:01:54,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 504793f6f02cfc3f492bdedca063c8a9, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:54,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 04:01:54,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93181d90b38fb4e3cd919e44f835a7fb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.', STARTKEY => '', ENDKEY => '2'} 2023-09-27 04:01:54,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 504793f6f02cfc3f492bdedca063c8a9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.', STARTKEY => '2', ENDKEY => ''} 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. service=AccessControlService 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. service=AccessControlService 2023-09-27 04:01:54,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:54,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:54,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,628 INFO [StoreOpener-504793f6f02cfc3f492bdedca063c8a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,628 INFO [StoreOpener-93181d90b38fb4e3cd919e44f835a7fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,629 DEBUG [StoreOpener-504793f6f02cfc3f492bdedca063c8a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf 2023-09-27 04:01:54,629 DEBUG [StoreOpener-93181d90b38fb4e3cd919e44f835a7fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf 2023-09-27 04:01:54,629 DEBUG [StoreOpener-504793f6f02cfc3f492bdedca063c8a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf 2023-09-27 04:01:54,629 DEBUG [StoreOpener-93181d90b38fb4e3cd919e44f835a7fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf 2023-09-27 04:01:54,630 INFO [StoreOpener-504793f6f02cfc3f492bdedca063c8a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 504793f6f02cfc3f492bdedca063c8a9 columnFamilyName cf 2023-09-27 04:01:54,630 INFO [StoreOpener-93181d90b38fb4e3cd919e44f835a7fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93181d90b38fb4e3cd919e44f835a7fb columnFamilyName cf 2023-09-27 04:01:54,630 INFO [StoreOpener-504793f6f02cfc3f492bdedca063c8a9-1] regionserver.HStore(310): Store=504793f6f02cfc3f492bdedca063c8a9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:54,631 INFO [StoreOpener-93181d90b38fb4e3cd919e44f835a7fb-1] regionserver.HStore(310): Store=93181d90b38fb4e3cd919e44f835a7fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:54,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:54,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:54,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:01:54,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 504793f6f02cfc3f492bdedca063c8a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72114763, jitterRate=0.07459370791912079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:54,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 93181d90b38fb4e3cd919e44f835a7fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64214751, jitterRate=-0.04312564432621002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:54,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 504793f6f02cfc3f492bdedca063c8a9: 2023-09-27 04:01:54,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 93181d90b38fb4e3cd919e44f835a7fb: 2023-09-27 04:01:54,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9., pid=70, masterSystemTime=1695787314623 2023-09-27 04:01:54,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb., pid=69, masterSystemTime=1695787314622 2023-09-27 04:01:54,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:54,639 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=93181d90b38fb4e3cd919e44f835a7fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314639"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787314639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787314639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787314639"}]},"ts":"1695787314639"} 2023-09-27 04:01:54,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:54,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=504793f6f02cfc3f492bdedca063c8a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314640"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787314640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787314640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787314640"}]},"ts":"1695787314640"} 2023-09-27 04:01:54,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-27 04:01:54,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 93181d90b38fb4e3cd919e44f835a7fb, server=jenkins-hbase17.apache.org,36187,1695787230796 in 173 msec 2023-09-27 04:01:54,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-27 04:01:54,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 504793f6f02cfc3f492bdedca063c8a9, server=jenkins-hbase17.apache.org,38525,1695787230747 in 171 msec 2023-09-27 04:01:54,645 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, ASSIGN in 334 msec 2023-09-27 04:01:54,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-27 04:01:54,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, ASSIGN in 335 msec 2023-09-27 04:01:54,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:01:54,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787314646"}]},"ts":"1695787314646"} 2023-09-27 04:01:54,648 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-27 04:01:54,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:01:54,651 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-27 04:01:54,653 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 04:01:54,654 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:54,654 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:54,654 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:54,654 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:01:54,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,656 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 04:01:54,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 387 msec 2023-09-27 04:01:54,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 04:01:54,877 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-27 04:01:54,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions 93181d90b38fb4e3cd919e44f835a7fb, 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:54,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[93181d90b38fb4e3cd919e44f835a7fb, 504793f6f02cfc3f492bdedca063c8a9], force=true 2023-09-27 04:01:54,915 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[93181d90b38fb4e3cd919e44f835a7fb, 504793f6f02cfc3f492bdedca063c8a9], force=true 2023-09-27 04:01:54,915 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[93181d90b38fb4e3cd919e44f835a7fb, 504793f6f02cfc3f492bdedca063c8a9], force=true 2023-09-27 04:01:54,915 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[93181d90b38fb4e3cd919e44f835a7fb, 504793f6f02cfc3f492bdedca063c8a9], force=true 2023-09-27 04:01:54,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 04:01:54,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, UNASSIGN}] 2023-09-27 04:01:54,944 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, UNASSIGN 2023-09-27 04:01:54,944 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, UNASSIGN 2023-09-27 04:01:54,945 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=93181d90b38fb4e3cd919e44f835a7fb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:54,945 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314945"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787314945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787314945"}]},"ts":"1695787314945"} 2023-09-27 04:01:54,945 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=504793f6f02cfc3f492bdedca063c8a9, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:54,945 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787314945"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787314945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787314945"}]},"ts":"1695787314945"} 2023-09-27 04:01:54,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 93181d90b38fb4e3cd919e44f835a7fb, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:01:54,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 504793f6f02cfc3f492bdedca063c8a9, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:01:55,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 04:01:55,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:55,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 93181d90b38fb4e3cd919e44f835a7fb, disabling compactions & flushes 2023-09-27 04:01:55,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:55,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:55,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. after waiting 0 ms 2023-09-27 04:01:55,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:55,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 93181d90b38fb4e3cd919e44f835a7fb 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 04:01:55,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:55,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 504793f6f02cfc3f492bdedca063c8a9, disabling compactions & flushes 2023-09-27 04:01:55,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:55,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:55,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. after waiting 0 ms 2023-09-27 04:01:55,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:55,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 504793f6f02cfc3f492bdedca063c8a9 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 04:01:55,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/.tmp/cf/91c762e5296a441397af56f2b259264e 2023-09-27 04:01:55,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/.tmp/cf/0fd146602cd6494aacdc4b159ca4d7ec 2023-09-27 04:01:55,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/.tmp/cf/0fd146602cd6494aacdc4b159ca4d7ec as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf/0fd146602cd6494aacdc4b159ca4d7ec 2023-09-27 04:01:55,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/.tmp/cf/91c762e5296a441397af56f2b259264e as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf/91c762e5296a441397af56f2b259264e 2023-09-27 04:01:55,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf/0fd146602cd6494aacdc4b159ca4d7ec, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 04:01:55,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 504793f6f02cfc3f492bdedca063c8a9 in 31ms, sequenceid=5, compaction requested=false 2023-09-27 04:01:55,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 04:01:55,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf/91c762e5296a441397af56f2b259264e, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 04:01:55,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 93181d90b38fb4e3cd919e44f835a7fb in 41ms, sequenceid=5, compaction requested=false 2023-09-27 04:01:55,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 04:01:55,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 04:01:55,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:55,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:01:55,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9. 2023-09-27 04:01:55,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb. 2023-09-27 04:01:55,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 504793f6f02cfc3f492bdedca063c8a9: 2023-09-27 04:01:55,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 93181d90b38fb4e3cd919e44f835a7fb: 2023-09-27 04:01:55,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:01:55,156 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=504793f6f02cfc3f492bdedca063c8a9, regionState=CLOSED 2023-09-27 04:01:55,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:01:55,156 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787315156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787315156"}]},"ts":"1695787315156"} 2023-09-27 04:01:55,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=93181d90b38fb4e3cd919e44f835a7fb, regionState=CLOSED 2023-09-27 04:01:55,157 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695787315157"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787315157"}]},"ts":"1695787315157"} 2023-09-27 04:01:55,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-27 04:01:55,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 504793f6f02cfc3f492bdedca063c8a9, server=jenkins-hbase17.apache.org,38525,1695787230747 in 211 msec 2023-09-27 04:01:55,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-27 04:01:55,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 93181d90b38fb4e3cd919e44f835a7fb, server=jenkins-hbase17.apache.org,36187,1695787230796 in 211 msec 2023-09-27 04:01:55,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=504793f6f02cfc3f492bdedca063c8a9, UNASSIGN in 218 msec 2023-09-27 04:01:55,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-27 04:01:55,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=93181d90b38fb4e3cd919e44f835a7fb, UNASSIGN in 224 msec 2023-09-27 04:01:55,216 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-27 04:01:55,218 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314267.93181d90b38fb4e3cd919e44f835a7fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:55,218 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695787314267.504793f6f02cfc3f492bdedca063c8a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:55,218 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 04:01:55,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 04:01:55,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, ASSIGN}] 2023-09-27 04:01:55,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, ASSIGN 2023-09-27 04:01:55,269 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,36187,1695787230796; forceNewPlan=false, retain=false 2023-09-27 04:01:55,420 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 04:01:55,422 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=339b52006c01d0d38f07b20d9b37af99, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:55,422 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695787315421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787315421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787315421"}]},"ts":"1695787315421"} 2023-09-27 04:01:55,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 339b52006c01d0d38f07b20d9b37af99, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:01:55,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 04:01:55,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:01:55,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 339b52006c01d0d38f07b20d9b37af99, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.', STARTKEY => '', ENDKEY => ''} 2023-09-27 04:01:55,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. service=AccessControlService 2023-09-27 04:01:55,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:01:55,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:01:55,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/.regioninfo 2023-09-27 04:01:55,602 INFO [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,604 DEBUG [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf 2023-09-27 04:01:55,604 DEBUG [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf 2023-09-27 04:01:55,604 INFO [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 339b52006c01d0d38f07b20d9b37af99 columnFamilyName cf 2023-09-27 04:01:55,649 DEBUG [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] regionserver.HStore(539): loaded hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/0fd146602cd6494aacdc4b159ca4d7ec.504793f6f02cfc3f492bdedca063c8a9->hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf/0fd146602cd6494aacdc4b159ca4d7ec-top 2023-09-27 04:01:55,660 DEBUG [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] regionserver.HStore(539): loaded hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/91c762e5296a441397af56f2b259264e.93181d90b38fb4e3cd919e44f835a7fb->hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf/91c762e5296a441397af56f2b259264e-top 2023-09-27 04:01:55,661 INFO [StoreOpener-339b52006c01d0d38f07b20d9b37af99-1] regionserver.HStore(310): Store=339b52006c01d0d38f07b20d9b37af99/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:01:55,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:01:55,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 339b52006c01d0d38f07b20d9b37af99; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71346851, jitterRate=0.06315092742443085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:01:55,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 339b52006c01d0d38f07b20d9b37af99: 2023-09-27 04:01:55,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99., pid=77, masterSystemTime=1695787315576 2023-09-27 04:01:55,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.,because compaction is disabled. 2023-09-27 04:01:55,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:01:55,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:01:55,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=339b52006c01d0d38f07b20d9b37af99, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:55,681 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695787315681"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787315681"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787315681"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787315681"}]},"ts":"1695787315681"} 2023-09-27 04:01:55,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-27 04:01:55,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 339b52006c01d0d38f07b20d9b37af99, server=jenkins-hbase17.apache.org,36187,1695787230796 in 264 msec 2023-09-27 04:01:55,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-27 04:01:55,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, ASSIGN in 423 msec 2023-09-27 04:01:55,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[93181d90b38fb4e3cd919e44f835a7fb, 504793f6f02cfc3f492bdedca063c8a9], force=true in 787 msec 2023-09-27 04:01:56,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 04:01:56,023 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-27 04:01:56,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 04:01:56,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787316024 (current time:1695787316024). 2023-09-27 04:01:56,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:01:56,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x66281420 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:56,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64c32f0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:56,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:56,039 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:56,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66281420 to 127.0.0.1:51909 2023-09-27 04:01:56,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:56,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x469d1f44 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:01:56,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60b29aa3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:01:56,054 DEBUG [hconnection-0x1d7462f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:56,058 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:56,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:01:56,065 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:01:56,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x469d1f44 to 127.0.0.1:51909 2023-09-27 04:01:56,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:01:56,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 04:01:56,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:01:56,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 04:01:56,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 04:01:56,070 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 04:01:56,071 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695787916071 2023-09-27 04:01:56,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 04:01:56,075 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:01:56,075 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:01:56,077 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 04:01:56,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 04:01:56,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-27 04:01:56,079 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 04:01:56,079 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695787916079 2023-09-27 04:01:56,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,088 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 04:01:56,088 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:56,089 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-27 04:01:56,089 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-27 04:01:56,090 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,090 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,090 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:56,091 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:56,091 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:56,091 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:56,091 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,091 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:01:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,092 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 04:01:56,093 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 04:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,093 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 04:01:56,093 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:56,093 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:56,094 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 04:01:56,094 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 04:01:56,096 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 04:01:56,094 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:01:56,096 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 04:01:56,096 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 04:01:56,097 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 04:01:56,097 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 04:01:56,097 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 04:01:56,097 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 04:01:56,097 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,099 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:56,099 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,100 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:01:56,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:56,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:56,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-27 04:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@581e2ed3[Count = 0] remaining members to acquire global barrier 2023-09-27 04:01:56,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-27 04:01:56,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,102 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 04:01:56,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,102 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 04:01:56,102 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:01:56,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:01:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:01:56,103 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:01:56,103 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:01:56,103 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. started... 2023-09-27 04:01:56,105 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 339b52006c01d0d38f07b20d9b37af99: 2023-09-27 04:01:56,105 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 04:01:56,105 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:56,105 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 04:01:56,105 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,107 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:01:56,108 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/0fd146602cd6494aacdc4b159ca4d7ec.504793f6f02cfc3f492bdedca063c8a9->hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf/0fd146602cd6494aacdc4b159ca4d7ec-top, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/91c762e5296a441397af56f2b259264e.93181d90b38fb4e3cd919e44f835a7fb->hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf/91c762e5296a441397af56f2b259264e-top] hfiles 2023-09-27 04:01:56,108 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/0fd146602cd6494aacdc4b159ca4d7ec.504793f6f02cfc3f492bdedca063c8a9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,108 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/91c762e5296a441397af56f2b259264e.93181d90b38fb4e3cd919e44f835a7fb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,108 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 04:01:56,109 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:56,109 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 04:01:56,121 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. completed. 2023-09-27 04:01:56,121 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:01:56,121 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:01:56,121 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:01:56,121 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,121 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 04:01:56,121 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:01:56,126 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 04:01:56,126 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,126 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:56,126 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 04:01:56,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:56,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:56,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:56,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,36187,1695787230796': 2023-09-27 04:01:56,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-27 04:01:56,131 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-27 04:01:56,131 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:01:56,131 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:01:56,131 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,131 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:01:56,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:01:56,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:56,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:56,132 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:01:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:56,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:56,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:56,133 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,134 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:01:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,139 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:01:56,140 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,140 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:01:56,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:56,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:56,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:01:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:01:56,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:01:56,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,144 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:01:56,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,144 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:56,145 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:56,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:56,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:01:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:56,145 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,145 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:01:56,146 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,146 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:01:56,146 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:01:56,146 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,146 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:01:56,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-27 04:01:56,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,163 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695787316071Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695787316144 (+73 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695787316145 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695787316148 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695787316155 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695787316162 (+7 ms) 2023-09-27 04:01:56,166 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 04:01:56,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 92 msec 2023-09-27 04:01:56,175 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:01:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-27 04:01:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:01:56,177 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177 2023-09-27 04:01:56,177 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39783, tgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177, rawTgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:56,198 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:01:56,198 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_747179087_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,198 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-27 04:01:56,207 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:01:56,252 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:56,252 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:56,253 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:56,253 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:56,670 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0004_000001 (auth:SIMPLE) 2023-09-27 04:01:57,138 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-5946287617009265762.jar 2023-09-27 04:01:57,139 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,139 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,220 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-4952388797082661635.jar 2023-09-27 04:01:57,221 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,222 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,222 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,223 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,223 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,223 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:01:57,224 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:01:57,225 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:01:57,225 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:01:57,226 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:01:57,226 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:01:57,227 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:01:57,227 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:01:57,228 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:01:57,228 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:01:57,229 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:01:57,230 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:57,230 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:57,231 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:57,232 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:57,232 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:01:57,233 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:57,233 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:01:58,178 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:01:58,195 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:01:58,198 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-27 04:01:58,201 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-27 04:01:58,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:58,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:01:58,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0005_000001 (auth:SIMPLE) 2023-09-27 04:02:02,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0005_000001 (auth:SIMPLE) 2023-09-27 04:02:05,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0005_000001 (auth:SIMPLE) 2023-09-27 04:02:07,789 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0005_000001 (auth:SIMPLE) 2023-09-27 04:02:09,442 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:02:09,444 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:02:09,453 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,453 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:02:09,454 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:02:09,454 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,454 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 04:02:09,455 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 04:02:09,455 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,455 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 04:02:09,455 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787316177/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 04:02:09,461 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 04:02:09,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787329466"}]},"ts":"1695787329466"} 2023-09-27 04:02:09,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-27 04:02:09,469 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-27 04:02:09,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, UNASSIGN}] 2023-09-27 04:02:09,471 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, UNASSIGN 2023-09-27 04:02:09,472 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=339b52006c01d0d38f07b20d9b37af99, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:09,472 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695787329472"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787329472"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787329472"}]},"ts":"1695787329472"} 2023-09-27 04:02:09,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 339b52006c01d0d38f07b20d9b37af99, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:02:09,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 04:02:09,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:02:09,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 339b52006c01d0d38f07b20d9b37af99, disabling compactions & flushes 2023-09-27 04:02:09,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:02:09,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:02:09,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. after waiting 0 ms 2023-09-27 04:02:09,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:02:09,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-27 04:02:09,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:09,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99. 2023-09-27 04:02:09,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 339b52006c01d0d38f07b20d9b37af99: 2023-09-27 04:02:09,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:02:09,637 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=339b52006c01d0d38f07b20d9b37af99, regionState=CLOSED 2023-09-27 04:02:09,638 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695787329637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787329637"}]},"ts":"1695787329637"} 2023-09-27 04:02:09,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-27 04:02:09,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 339b52006c01d0d38f07b20d9b37af99, server=jenkins-hbase17.apache.org,36187,1695787230796 in 166 msec 2023-09-27 04:02:09,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-27 04:02:09,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=339b52006c01d0d38f07b20d9b37af99, UNASSIGN in 171 msec 2023-09-27 04:02:09,642 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787329642"}]},"ts":"1695787329642"} 2023-09-27 04:02:09,643 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-27 04:02:09,644 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-27 04:02:09,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 183 msec 2023-09-27 04:02:09,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 04:02:09,769 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-27 04:02:09,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,773 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,774 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,775 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,776 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,776 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,776 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,776 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,777 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 04:02:09,777 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-27 04:02:09,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:09,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:09,778 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 04:02:09,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:09,777 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,778 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:09,778 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 04:02:09,778 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 04:02:09,778 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 04:02:09,778 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:02:09,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 04:02:09,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:09,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:09,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:09,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:09,780 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:02:09,780 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:02:09,781 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/recovered.edits] 2023-09-27 04:02:09,781 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/recovered.edits] 2023-09-27 04:02:09,782 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/recovered.edits] 2023-09-27 04:02:09,785 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/0fd146602cd6494aacdc4b159ca4d7ec.504793f6f02cfc3f492bdedca063c8a9 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/0fd146602cd6494aacdc4b159ca4d7ec.504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:02:09,785 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf/0fd146602cd6494aacdc4b159ca4d7ec to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/cf/0fd146602cd6494aacdc4b159ca4d7ec 2023-09-27 04:02:09,785 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf/91c762e5296a441397af56f2b259264e to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/cf/91c762e5296a441397af56f2b259264e 2023-09-27 04:02:09,786 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/91c762e5296a441397af56f2b259264e.93181d90b38fb4e3cd919e44f835a7fb to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/cf/91c762e5296a441397af56f2b259264e.93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:02:09,787 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/recovered.edits/8.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb/recovered.edits/8.seqid 2023-09-27 04:02:09,788 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/recovered.edits/8.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9/recovered.edits/8.seqid 2023-09-27 04:02:09,788 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/93181d90b38fb4e3cd919e44f835a7fb 2023-09-27 04:02:09,788 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/504793f6f02cfc3f492bdedca063c8a9 2023-09-27 04:02:09,788 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/recovered.edits/12.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99/recovered.edits/12.seqid 2023-09-27 04:02:09,789 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/339b52006c01d0d38f07b20d9b37af99 2023-09-27 04:02:09,789 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 04:02:09,790 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,793 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-27 04:02:09,794 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-27 04:02:09,795 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,795 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-27 04:02:09,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787329795"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:09,797 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-27 04:02:09,797 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 339b52006c01d0d38f07b20d9b37af99, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695787314268.339b52006c01d0d38f07b20d9b37af99.', STARTKEY => '', ENDKEY => ''}] 2023-09-27 04:02:09,797 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-27 04:02:09,797 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787329797"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:09,799 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-27 04:02:09,800 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:09,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 30 msec 2023-09-27 04:02:09,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 04:02:09,880 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-27 04:02:09,881 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:09,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:09,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:09,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 04:02:09,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787329887"}]},"ts":"1695787329887"} 2023-09-27 04:02:09,888 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-27 04:02:09,890 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-27 04:02:09,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, UNASSIGN}] 2023-09-27 04:02:09,892 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, UNASSIGN 2023-09-27 04:02:09,893 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, UNASSIGN 2023-09-27 04:02:09,894 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9c95eed1f97f3191e0ff1dda09def4e5, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:09,894 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0f0b42f1b0a45932a6f6ba8cb5e8de71, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:09,894 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787329894"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787329894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787329894"}]},"ts":"1695787329894"} 2023-09-27 04:02:09,894 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787329894"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787329894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787329894"}]},"ts":"1695787329894"} 2023-09-27 04:02:09,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9c95eed1f97f3191e0ff1dda09def4e5, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:02:09,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 0f0b42f1b0a45932a6f6ba8cb5e8de71, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:02:09,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 04:02:10,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:02:10,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9c95eed1f97f3191e0ff1dda09def4e5, disabling compactions & flushes 2023-09-27 04:02:10,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:02:10,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:02:10,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. after waiting 0 ms 2023-09-27 04:02:10,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:02:10,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:02:10,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0f0b42f1b0a45932a6f6ba8cb5e8de71, disabling compactions & flushes 2023-09-27 04:02:10,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:02:10,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:02:10,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. after waiting 0 ms 2023-09-27 04:02:10,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:02:10,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:02:10,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:10,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5. 2023-09-27 04:02:10,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9c95eed1f97f3191e0ff1dda09def4e5: 2023-09-27 04:02:10,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:02:10,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:10,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71. 2023-09-27 04:02:10,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0f0b42f1b0a45932a6f6ba8cb5e8de71: 2023-09-27 04:02:10,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:02:10,064 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9c95eed1f97f3191e0ff1dda09def4e5, regionState=CLOSED 2023-09-27 04:02:10,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:02:10,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787330064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787330064"}]},"ts":"1695787330064"} 2023-09-27 04:02:10,065 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0f0b42f1b0a45932a6f6ba8cb5e8de71, regionState=CLOSED 2023-09-27 04:02:10,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695787330065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787330065"}]},"ts":"1695787330065"} 2023-09-27 04:02:10,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-27 04:02:10,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9c95eed1f97f3191e0ff1dda09def4e5, server=jenkins-hbase17.apache.org,38525,1695787230747 in 170 msec 2023-09-27 04:02:10,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-27 04:02:10,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 0f0b42f1b0a45932a6f6ba8cb5e8de71, server=jenkins-hbase17.apache.org,44775,1695787230832 in 165 msec 2023-09-27 04:02:10,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c95eed1f97f3191e0ff1dda09def4e5, UNASSIGN in 176 msec 2023-09-27 04:02:10,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-27 04:02:10,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0f0b42f1b0a45932a6f6ba8cb5e8de71, UNASSIGN in 177 msec 2023-09-27 04:02:10,069 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787330069"}]},"ts":"1695787330069"} 2023-09-27 04:02:10,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-27 04:02:10,071 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-27 04:02:10,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-09-27 04:02:10,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 04:02:10,189 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-27 04:02:10,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,194 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,194 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,195 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,212 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,212 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,212 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,212 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 04:02:10,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 04:02:10,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 04:02:10,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 04:02:10,214 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:02:10,214 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:02:10,215 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,215 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,215 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,215 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,215 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,215 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,216 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,216 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,216 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/recovered.edits] 2023-09-27 04:02:10,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 04:02:10,217 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/recovered.edits] 2023-09-27 04:02:10,225 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf/6eb4dcd3eae3412893a7860d344d68d1 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/cf/6eb4dcd3eae3412893a7860d344d68d1 2023-09-27 04:02:10,226 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf/eabf53fbffc6485fb54a9159d2577fac to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/cf/eabf53fbffc6485fb54a9159d2577fac 2023-09-27 04:02:10,230 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71/recovered.edits/9.seqid 2023-09-27 04:02:10,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5/recovered.edits/9.seqid 2023-09-27 04:02:10,231 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0f0b42f1b0a45932a6f6ba8cb5e8de71 2023-09-27 04:02:10,231 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c95eed1f97f3191e0ff1dda09def4e5 2023-09-27 04:02:10,231 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 04:02:10,232 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 04:02:10,233 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-27 04:02:10,236 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092791a2c1829d91467d91afcd48d005a573 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092791a2c1829d91467d91afcd48d005a573 2023-09-27 04:02:10,237 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f381122e0a9f4d0686bd3d2daf109ba9 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f381122e0a9f4d0686bd3d2daf109ba9 2023-09-27 04:02:10,238 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 04:02:10,241 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,261 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-27 04:02:10,264 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-27 04:02:10,265 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,265 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-27 04:02:10,266 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787330265"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:10,266 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787330265"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:10,267 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 04:02:10,267 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c95eed1f97f3191e0ff1dda09def4e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695787312852.9c95eed1f97f3191e0ff1dda09def4e5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0f0b42f1b0a45932a6f6ba8cb5e8de71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695787312852.0f0b42f1b0a45932a6f6ba8cb5e8de71.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 04:02:10,267 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-27 04:02:10,268 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787330268"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:10,269 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-27 04:02:10,270 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 80 msec 2023-09-27 04:02:10,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 04:02:10,319 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-27 04:02:10,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 04:02:10,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 04:02:10,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 04:02:10,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-27 04:02:10,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 04:02:10,383 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:58336 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:50484 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-879688514_1 at /127.0.0.1:39842 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-879688514_1 at /127.0.0.1:33338 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:46491 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x198566fb-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:33356 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4075 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: java.util.concurrent.ThreadPoolExecutor$Worker@607dde90[State = -1, empty queue] sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=459 (was 491), ProcessCount=174 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=2100 (was 3050) 2023-09-27 04:02:10,383 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-27 04:02:10,404 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=459, ProcessCount=174, AvailableMemoryMB=2099 2023-09-27 04:02:10,404 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-09-27 04:02:10,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 04:02:10,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:10,409 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:02:10,410 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-27 04:02:10,410 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:02:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 04:02:10,413 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,413 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,413 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 empty. 2023-09-27 04:02:10,413 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b empty. 2023-09-27 04:02:10,414 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,414 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,414 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 04:02:10,443 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 04:02:10,445 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83f51d4d95e82bbc657e9b5a8fe52dd9, NAME => 'testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:02:10,445 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f5b17d4c5382485b44ba487d3b3e078b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:02:10,467 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 83f51d4d95e82bbc657e9b5a8fe52dd9, disabling compactions & flushes 2023-09-27 04:02:10,468 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. after waiting 0 ms 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,468 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 83f51d4d95e82bbc657e9b5a8fe52dd9: 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f5b17d4c5382485b44ba487d3b3e078b, disabling compactions & flushes 2023-09-27 04:02:10,468 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. after waiting 0 ms 2023-09-27 04:02:10,468 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,469 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f5b17d4c5382485b44ba487d3b3e078b: 2023-09-27 04:02:10,471 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:02:10,472 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787330471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787330471"}]},"ts":"1695787330471"} 2023-09-27 04:02:10,472 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787330471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787330471"}]},"ts":"1695787330471"} 2023-09-27 04:02:10,473 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:02:10,474 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:02:10,474 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787330474"}]},"ts":"1695787330474"} 2023-09-27 04:02:10,475 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 04:02:10,477 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:02:10,478 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:02:10,478 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:02:10,478 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:02:10,478 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:02:10,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, ASSIGN}] 2023-09-27 04:02:10,482 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, ASSIGN 2023-09-27 04:02:10,482 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, ASSIGN 2023-09-27 04:02:10,483 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38525,1695787230747; forceNewPlan=false, retain=false 2023-09-27 04:02:10,483 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44775,1695787230832; forceNewPlan=false, retain=false 2023-09-27 04:02:10,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 04:02:10,633 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:02:10,636 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f5b17d4c5382485b44ba487d3b3e078b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:10,636 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=83f51d4d95e82bbc657e9b5a8fe52dd9, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:10,636 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787330636"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787330636"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787330636"}]},"ts":"1695787330636"} 2023-09-27 04:02:10,636 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787330636"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787330636"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787330636"}]},"ts":"1695787330636"} 2023-09-27 04:02:10,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f5b17d4c5382485b44ba487d3b3e078b, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:02:10,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 83f51d4d95e82bbc657e9b5a8fe52dd9, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:02:10,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 04:02:10,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5b17d4c5382485b44ba487d3b3e078b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83f51d4d95e82bbc657e9b5a8fe52dd9, NAME => 'testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. service=AccessControlService 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. service=AccessControlService 2023-09-27 04:02:10,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:02:10,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,795 INFO [StoreOpener-83f51d4d95e82bbc657e9b5a8fe52dd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,795 INFO [StoreOpener-f5b17d4c5382485b44ba487d3b3e078b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,796 DEBUG [StoreOpener-83f51d4d95e82bbc657e9b5a8fe52dd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf 2023-09-27 04:02:10,796 DEBUG [StoreOpener-f5b17d4c5382485b44ba487d3b3e078b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf 2023-09-27 04:02:10,796 DEBUG [StoreOpener-f5b17d4c5382485b44ba487d3b3e078b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf 2023-09-27 04:02:10,796 DEBUG [StoreOpener-83f51d4d95e82bbc657e9b5a8fe52dd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf 2023-09-27 04:02:10,796 INFO [StoreOpener-83f51d4d95e82bbc657e9b5a8fe52dd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83f51d4d95e82bbc657e9b5a8fe52dd9 columnFamilyName cf 2023-09-27 04:02:10,796 INFO [StoreOpener-f5b17d4c5382485b44ba487d3b3e078b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5b17d4c5382485b44ba487d3b3e078b columnFamilyName cf 2023-09-27 04:02:10,797 INFO [StoreOpener-83f51d4d95e82bbc657e9b5a8fe52dd9-1] regionserver.HStore(310): Store=83f51d4d95e82bbc657e9b5a8fe52dd9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:02:10,797 INFO [StoreOpener-f5b17d4c5382485b44ba487d3b3e078b-1] regionserver.HStore(310): Store=f5b17d4c5382485b44ba487d3b3e078b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:02:10,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:10,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:10,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:02:10,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:02:10,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f5b17d4c5382485b44ba487d3b3e078b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62255321, jitterRate=-0.07232342660427094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:02:10,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 83f51d4d95e82bbc657e9b5a8fe52dd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60187692, jitterRate=-0.10313349962234497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:02:10,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f5b17d4c5382485b44ba487d3b3e078b: 2023-09-27 04:02:10,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 83f51d4d95e82bbc657e9b5a8fe52dd9: 2023-09-27 04:02:10,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b., pid=93, masterSystemTime=1695787330789 2023-09-27 04:02:10,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9., pid=94, masterSystemTime=1695787330790 2023-09-27 04:02:10,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:10,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=83f51d4d95e82bbc657e9b5a8fe52dd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:10,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,813 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787330813"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787330813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787330813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787330813"}]},"ts":"1695787330813"} 2023-09-27 04:02:10,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:10,814 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f5b17d4c5382485b44ba487d3b3e078b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:10,814 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787330813"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787330813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787330813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787330813"}]},"ts":"1695787330813"} 2023-09-27 04:02:10,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-27 04:02:10,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 83f51d4d95e82bbc657e9b5a8fe52dd9, server=jenkins-hbase17.apache.org,38525,1695787230747 in 176 msec 2023-09-27 04:02:10,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-27 04:02:10,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f5b17d4c5382485b44ba487d3b3e078b, server=jenkins-hbase17.apache.org,44775,1695787230832 in 177 msec 2023-09-27 04:02:10,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, ASSIGN in 337 msec 2023-09-27 04:02:10,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-27 04:02:10,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, ASSIGN in 338 msec 2023-09-27 04:02:10,819 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:02:10,819 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787330819"}]},"ts":"1695787330819"} 2023-09-27 04:02:10,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 04:02:10,823 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:02:10,823 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-27 04:02:10,825 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 04:02:10,826 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,826 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,826 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,826 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:10,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:10,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:10,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:10,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:10,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 421 msec 2023-09-27 04:02:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 04:02:11,014 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-27 04:02:11,016 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:11,017 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:11,018 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:02:11,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:02:11,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787331036 (current time:1695787331036). 2023-09-27 04:02:11,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:02:11,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x1122835c to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:11,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3db7ae4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:11,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:11,052 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:11,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1122835c to 127.0.0.1:51909 2023-09-27 04:02:11,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:11,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x6cdedbc1 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:11,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69639d65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:11,063 DEBUG [hconnection-0x69a6a3f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:11,066 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:11,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:11,072 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:11,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cdedbc1 to 127.0.0.1:51909 2023-09-27 04:02:11,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:11,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 04:02:11,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:02:11,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:02:11,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:02:11,078 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:02:11,079 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695787931079 2023-09-27 04:02:11,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:02:11,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:11,080 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:02:11,081 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:02:11,082 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:02:11,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 04:02:11,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-27 04:02:11,086 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 04:02:11,087 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695787931087 2023-09-27 04:02:11,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,095 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-27 04:02:11,095 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,097 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 04:02:11,097 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 04:02:11,097 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,098 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,101 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,101 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,101 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,101 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:02:11,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,102 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 04:02:11,103 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,102 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 04:02:11,103 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,106 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 04:02:11,106 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 04:02:11,106 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,106 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 04:02:11,108 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 04:02:11,108 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 04:02:11,106 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 04:02:11,108 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 04:02:11,108 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 04:02:11,108 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 04:02:11,108 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 04:02:11,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,110 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,110 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,110 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,110 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,111 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,111 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:11,111 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,111 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,111 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:11,111 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f8e642[Count = 1] remaining members to acquire global barrier 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 04:02:11,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f8e642[Count = 0] remaining members to acquire global barrier 2023-09-27 04:02:11,115 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 04:02:11,115 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:02:11,116 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 04:02:11,116 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,116 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:02:11,116 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:02:11,116 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. started... 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:11,116 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f5b17d4c5382485b44ba487d3b3e078b: 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. started... 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83f51d4d95e82bbc657e9b5a8fe52dd9: 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:11,118 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:02:11,119 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 04:02:11,119 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,119 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 04:02:11,131 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. completed. 2023-09-27 04:02:11,131 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:11,131 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. completed. 2023-09-27 04:02:11,131 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,131 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 04:02:11,132 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:02:11,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,132 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 04:02:11,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,132 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,132 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 04:02:11,132 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,133 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,133 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 04:02:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,134 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 04:02:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:02:11,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 04:02:11,142 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 04:02:11,142 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:02:11,142 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:02:11,142 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,142 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,144 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,143 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,144 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,145 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,146 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,147 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,147 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,148 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,148 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,149 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,150 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:02:11,149 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,150 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,151 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,151 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,151 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,151 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 04:02:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 04:02:11,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,181 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695787331079Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695787331162 (+83 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695787331162Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695787331162Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695787331165 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695787331174 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695787331180 (+6 ms) 2023-09-27 04:02:11,182 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:11,184 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 04:02:11,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:02:11,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:02:11,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 104 msec 2023-09-27 04:02:11,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38525] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:02:11,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44775] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:02:11,191 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:11,191 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:11,191 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:02:11,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:02:11,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787331204 (current time:1695787331204). 2023-09-27 04:02:11,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:02:11,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x1d6d736c to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4188ca36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:11,216 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:11,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d6d736c to 127.0.0.1:51909 2023-09-27 04:02:11,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:11,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x0db4fb7b to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:11,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b340fb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:11,226 DEBUG [hconnection-0x7ceab398-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:11,227 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:11,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:11,241 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:11,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0db4fb7b to 127.0.0.1:51909 2023-09-27 04:02:11,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:11,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 04:02:11,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:02:11,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:02:11,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:02:11,246 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:02:11,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 04:02:11,247 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695787931247 2023-09-27 04:02:11,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:11,249 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:02:11,249 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:02:11,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 04:02:11,251 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 04:02:11,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-27 04:02:11,255 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 04:02:11,255 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695787931255 2023-09-27 04:02:11,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,269 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-27 04:02:11,269 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,270 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 04:02:11,270 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 04:02:11,271 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,271 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,272 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,272 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,272 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,272 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,272 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,272 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,273 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,273 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 04:02:11,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 04:02:11,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 04:02:11,274 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 04:02:11,274 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,275 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 04:02:11,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,275 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 04:02:11,275 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 04:02:11,275 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 04:02:11,275 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 04:02:11,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,276 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 04:02:11,276 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 04:02:11,276 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,276 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:11,277 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 04:02:11,277 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 04:02:11,277 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 04:02:11,282 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 04:02:11,282 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 04:02:11,282 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 04:02:11,283 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,283 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,283 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,284 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,284 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,284 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,285 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:11,284 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,285 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,285 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,285 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4434bae9[Count = 1] remaining members to acquire global barrier 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 04:02:11,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4434bae9[Count = 0] remaining members to acquire global barrier 2023-09-27 04:02:11,287 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 04:02:11,287 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,288 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:02:11,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,289 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,289 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:02:11,289 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:11,289 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:11,289 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 04:02:11,289 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:11,289 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 04:02:11,289 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:02:11,289 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. started... 2023-09-27 04:02:11,289 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,289 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:02:11,289 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f5b17d4c5382485b44ba487d3b3e078b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-27 04:02:11,293 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:11,293 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:11,293 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:11,293 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. started... 2023-09-27 04:02:11,293 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83f51d4d95e82bbc657e9b5a8fe52dd9 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-27 04:02:11,294 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 04:02:11,294 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,294 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 04:02:11,339 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092704b42e5d0dd34692ad8c826b20de2c21 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092704b42e5d0dd34692ad8c826b20de2c21 2023-09-27 04:02:11,340 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927c1109ebbae394fdab3d17b7296be4e6f to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1109ebbae394fdab3d17b7296be4e6f 2023-09-27 04:02:11,349 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:11,350 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/.tmp/cf/a940f5379e1b4a509fac3bbdb4aa742a 2023-09-27 04:02:11,350 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/.tmp/cf/fa083a4742cb481587794dc01bf67478 2023-09-27 04:02:11,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:02:11,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:02:11,351 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:02:11,356 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/.tmp/cf/a940f5379e1b4a509fac3bbdb4aa742a as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf/a940f5379e1b4a509fac3bbdb4aa742a 2023-09-27 04:02:11,356 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/.tmp/cf/fa083a4742cb481587794dc01bf67478 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf/fa083a4742cb481587794dc01bf67478 2023-09-27 04:02:11,362 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf/fa083a4742cb481587794dc01bf67478, entries=46, sequenceid=6, filesize=12.9 K 2023-09-27 04:02:11,362 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf/a940f5379e1b4a509fac3bbdb4aa742a, entries=4, sequenceid=6, filesize=5.6 K 2023-09-27 04:02:11,363 INFO [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 83f51d4d95e82bbc657e9b5a8fe52dd9 in 70ms, sequenceid=6, compaction requested=false 2023-09-27 04:02:11,363 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f5b17d4c5382485b44ba487d3b3e078b in 74ms, sequenceid=6, compaction requested=false 2023-09-27 04:02:11,363 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 04:02:11,363 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 04:02:11,366 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f5b17d4c5382485b44ba487d3b3e078b: 2023-09-27 04:02:11,366 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83f51d4d95e82bbc657e9b5a8fe52dd9: 2023-09-27 04:02:11,366 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,366 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:11,366 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,366 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf/fa083a4742cb481587794dc01bf67478] hfiles 2023-09-27 04:02:11,367 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:11,367 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf/fa083a4742cb481587794dc01bf67478 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,367 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf/a940f5379e1b4a509fac3bbdb4aa742a] hfiles 2023-09-27 04:02:11,367 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf/a940f5379e1b4a509fac3bbdb4aa742a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,392 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. completed. 2023-09-27 04:02:11,392 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:11,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:11,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:11,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,392 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 04:02:11,393 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:02:11,393 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,395 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 04:02:11,395 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,395 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 04:02:11,396 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. completed. 2023-09-27 04:02:11,397 DEBUG [rs(jenkins-hbase17.apache.org,38525,1695787230747)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:11,397 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:11,397 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:11,397 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,397 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 04:02:11,397 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:02:11,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,404 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 04:02:11,404 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,404 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,404 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 04:02:11,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,38525,1695787230747': 2023-09-27 04:02:11,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 04:02:11,411 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 04:02:11,411 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:02:11,411 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:02:11,411 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,411 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:11,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,413 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,413 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,413 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,414 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,415 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:11,415 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:11,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,417 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:11,417 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:11,418 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:02:11,419 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:11,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:11,419 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:11,419 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:11,419 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:11,419 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,419 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092704b42e5d0dd34692ad8c826b20de2c21, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1109ebbae394fdab3d17b7296be4e6f] mob files 2023-09-27 04:02:11,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092704b42e5d0dd34692ad8c826b20de2c21 2023-09-27 04:02:11,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1109ebbae394fdab3d17b7296be4e6f 2023-09-27 04:02:11,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 04:02:11,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,454 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695787331248Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695787331425 (+177 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695787331425Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695787331425Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695787331430 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695787331438 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695787331453 (+15 ms) 2023-09-27 04:02:11,458 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 04:02:11,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 210 msec 2023-09-27 04:02:11,551 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:11,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 04:02:11,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:02:11,552 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552 2023-09-27 04:02:11,552 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39783, tgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552, rawTgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:02:11,571 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:02:11,571 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-634281171_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,571 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-27 04:02:11,576 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:11,609 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:11,609 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:11,609 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:11,610 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,423 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-3001110637306141772.jar 2023-09-27 04:02:12,424 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,424 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,481 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-8531996592152768928.jar 2023-09-27 04:02:12,482 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,482 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,483 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,483 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,483 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,483 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:12,484 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:02:12,484 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:02:12,484 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:02:12,485 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:02:12,485 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:02:12,485 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:02:12,486 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:02:12,486 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:02:12,486 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:02:12,487 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:02:12,487 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:12,488 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:12,488 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:02:12,488 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:12,489 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:12,489 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:02:12,490 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:02:12,886 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:02:12,888 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-27 04:02:13,952 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:02:13,952 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:02:13,954 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0005_000001 (auth:SIMPLE) 2023-09-27 04:02:14,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0006_000001 (auth:SIMPLE) 2023-09-27 04:02:15,235 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:02:18,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0006_000001 (auth:SIMPLE) 2023-09-27 04:02:21,246 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:02:21,247 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:02:21,252 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:21,252 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:02:21,252 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:02:21,252 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:21,253 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 04:02:21,253 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 04:02:21,253 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:21,254 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 04:02:21,254 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787331552/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 04:02:21,258 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 04:02:21,262 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787341262"}]},"ts":"1695787341262"} 2023-09-27 04:02:21,263 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 04:02:21,264 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-27 04:02:21,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, UNASSIGN}] 2023-09-27 04:02:21,266 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, UNASSIGN 2023-09-27 04:02:21,266 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, UNASSIGN 2023-09-27 04:02:21,267 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f5b17d4c5382485b44ba487d3b3e078b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:21,267 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=83f51d4d95e82bbc657e9b5a8fe52dd9, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:21,267 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787341267"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787341267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787341267"}]},"ts":"1695787341267"} 2023-09-27 04:02:21,267 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787341267"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787341267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787341267"}]},"ts":"1695787341267"} 2023-09-27 04:02:21,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 83f51d4d95e82bbc657e9b5a8fe52dd9, server=jenkins-hbase17.apache.org,38525,1695787230747}] 2023-09-27 04:02:21,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure f5b17d4c5382485b44ba487d3b3e078b, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:02:21,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 04:02:21,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:21,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 83f51d4d95e82bbc657e9b5a8fe52dd9, disabling compactions & flushes 2023-09-27 04:02:21,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:21,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:21,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. after waiting 0 ms 2023-09-27 04:02:21,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:21,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:21,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f5b17d4c5382485b44ba487d3b3e078b, disabling compactions & flushes 2023-09-27 04:02:21,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:21,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:21,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. after waiting 0 ms 2023-09-27 04:02:21,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:21,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:02:21,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:02:21,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:21,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b. 2023-09-27 04:02:21,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f5b17d4c5382485b44ba487d3b3e078b: 2023-09-27 04:02:21,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:21,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9. 2023-09-27 04:02:21,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 83f51d4d95e82bbc657e9b5a8fe52dd9: 2023-09-27 04:02:21,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:21,445 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f5b17d4c5382485b44ba487d3b3e078b, regionState=CLOSED 2023-09-27 04:02:21,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:21,446 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787341445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787341445"}]},"ts":"1695787341445"} 2023-09-27 04:02:21,446 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=83f51d4d95e82bbc657e9b5a8fe52dd9, regionState=CLOSED 2023-09-27 04:02:21,446 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695787341446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787341446"}]},"ts":"1695787341446"} 2023-09-27 04:02:21,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-27 04:02:21,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-27 04:02:21,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 83f51d4d95e82bbc657e9b5a8fe52dd9, server=jenkins-hbase17.apache.org,38525,1695787230747 in 180 msec 2023-09-27 04:02:21,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure f5b17d4c5382485b44ba487d3b3e078b, server=jenkins-hbase17.apache.org,44775,1695787230832 in 179 msec 2023-09-27 04:02:21,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=83f51d4d95e82bbc657e9b5a8fe52dd9, UNASSIGN in 185 msec 2023-09-27 04:02:21,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-27 04:02:21,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f5b17d4c5382485b44ba487d3b3e078b, UNASSIGN in 185 msec 2023-09-27 04:02:21,456 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787341456"}]},"ts":"1695787341456"} 2023-09-27 04:02:21,458 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 04:02:21,459 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-27 04:02:21,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 201 msec 2023-09-27 04:02:21,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 04:02:21,564 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-27 04:02:21,565 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,568 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,568 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,570 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,571 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,571 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,571 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,572 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,572 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:21,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 04:02:21,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 04:02:21,572 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:21,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:21,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:21,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-09-27 04:02:21,574 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 04:02:21,574 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/recovered.edits] 2023-09-27 04:02:21,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 04:02:21,574 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/recovered.edits] 2023-09-27 04:02:21,578 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf/a940f5379e1b4a509fac3bbdb4aa742a to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/cf/a940f5379e1b4a509fac3bbdb4aa742a 2023-09-27 04:02:21,578 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf/fa083a4742cb481587794dc01bf67478 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/cf/fa083a4742cb481587794dc01bf67478 2023-09-27 04:02:21,581 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9/recovered.edits/9.seqid 2023-09-27 04:02:21,581 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b/recovered.edits/9.seqid 2023-09-27 04:02:21,582 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/83f51d4d95e82bbc657e9b5a8fe52dd9 2023-09-27 04:02:21,582 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testEmptyExportFileSystemState/f5b17d4c5382485b44ba487d3b3e078b 2023-09-27 04:02:21,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 04:02:21,582 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 04:02:21,583 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-27 04:02:21,586 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092704b42e5d0dd34692ad8c826b20de2c21 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092704b42e5d0dd34692ad8c826b20de2c21 2023-09-27 04:02:21,588 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1109ebbae394fdab3d17b7296be4e6f to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1109ebbae394fdab3d17b7296be4e6f 2023-09-27 04:02:21,588 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 04:02:21,590 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,592 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-27 04:02:21,594 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-27 04:02:21,596 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,596 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-27 04:02:21,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787341596"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:21,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787341596"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:21,601 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 04:02:21,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 83f51d4d95e82bbc657e9b5a8fe52dd9, NAME => 'testtb-testEmptyExportFileSystemState,,1695787330405.83f51d4d95e82bbc657e9b5a8fe52dd9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f5b17d4c5382485b44ba487d3b3e078b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695787330405.f5b17d4c5382485b44ba487d3b3e078b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 04:02:21,601 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-27 04:02:21,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787341601"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:21,603 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-27 04:02:21,604 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 04:02:21,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-27 04:02:21,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 04:02:21,676 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-27 04:02:21,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-27 04:02:21,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:21,686 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-27 04:02:21,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-27 04:02:21,709 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 761) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:46373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x198566fb-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:35797 from appattempt_1695787237352_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:59934 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:55440 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4726 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:57430 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:37755 from appattempt_1695787237352_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_708067685_1 at /127.0.0.1:57418 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_708067685_1 at /127.0.0.1:42262 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=490 (was 459) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=1857 (was 2099) 2023-09-27 04:02:21,710 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-27 04:02:21,729 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=490, ProcessCount=174, AvailableMemoryMB=1856 2023-09-27 04:02:21,729 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-27 04:02:21,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 04:02:21,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:21,735 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 04:02:21,735 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-27 04:02:21,736 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 04:02:21,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 04:02:21,738 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:21,738 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:21,738 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 empty. 2023-09-27 04:02:21,738 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa empty. 2023-09-27 04:02:21,739 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:21,739 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:21,739 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 04:02:21,748 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-27 04:02:21,749 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8f0200d3ef43a02efbc6267027b9c1a6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:02:21,750 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a927bfc7816ed9c11c541458a68d27aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 8f0200d3ef43a02efbc6267027b9c1a6, disabling compactions & flushes 2023-09-27 04:02:21,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. after waiting 0 ms 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a927bfc7816ed9c11c541458a68d27aa, disabling compactions & flushes 2023-09-27 04:02:21,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:21,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 8f0200d3ef43a02efbc6267027b9c1a6: 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. after waiting 0 ms 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:21,766 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:21,766 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a927bfc7816ed9c11c541458a68d27aa: 2023-09-27 04:02:21,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 04:02:21,769 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787341769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787341769"}]},"ts":"1695787341769"} 2023-09-27 04:02:21,770 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787341769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787341769"}]},"ts":"1695787341769"} 2023-09-27 04:02:21,771 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 04:02:21,772 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 04:02:21,772 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787341772"}]},"ts":"1695787341772"} 2023-09-27 04:02:21,774 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-27 04:02:21,776 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-27 04:02:21,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 04:02:21,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 04:02:21,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 04:02:21,777 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 04:02:21,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, ASSIGN}] 2023-09-27 04:02:21,780 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, ASSIGN 2023-09-27 04:02:21,780 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, ASSIGN 2023-09-27 04:02:21,781 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36187,1695787230796; forceNewPlan=false, retain=false 2023-09-27 04:02:21,781 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,44775,1695787230832; forceNewPlan=false, retain=false 2023-09-27 04:02:21,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 04:02:21,931 INFO [jenkins-hbase17:43371] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 04:02:21,935 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8f0200d3ef43a02efbc6267027b9c1a6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:21,935 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a927bfc7816ed9c11c541458a68d27aa, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:21,935 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787341935"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787341935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787341935"}]},"ts":"1695787341935"} 2023-09-27 04:02:21,935 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787341935"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787341935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787341935"}]},"ts":"1695787341935"} 2023-09-27 04:02:21,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 8f0200d3ef43a02efbc6267027b9c1a6, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:02:21,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure a927bfc7816ed9c11c541458a68d27aa, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:02:22,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 04:02:22,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f0200d3ef43a02efbc6267027b9c1a6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. service=AccessControlService 2023-09-27 04:02:22,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a927bfc7816ed9c11c541458a68d27aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. service=AccessControlService 2023-09-27 04:02:22,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 04:02:22,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 04:02:22,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,097 INFO [StoreOpener-8f0200d3ef43a02efbc6267027b9c1a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,097 INFO [StoreOpener-a927bfc7816ed9c11c541458a68d27aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,098 DEBUG [StoreOpener-8f0200d3ef43a02efbc6267027b9c1a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf 2023-09-27 04:02:22,098 DEBUG [StoreOpener-8f0200d3ef43a02efbc6267027b9c1a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf 2023-09-27 04:02:22,098 INFO [StoreOpener-8f0200d3ef43a02efbc6267027b9c1a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f0200d3ef43a02efbc6267027b9c1a6 columnFamilyName cf 2023-09-27 04:02:22,099 DEBUG [StoreOpener-a927bfc7816ed9c11c541458a68d27aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf 2023-09-27 04:02:22,099 DEBUG [StoreOpener-a927bfc7816ed9c11c541458a68d27aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf 2023-09-27 04:02:22,099 INFO [StoreOpener-a927bfc7816ed9c11c541458a68d27aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a927bfc7816ed9c11c541458a68d27aa columnFamilyName cf 2023-09-27 04:02:22,100 INFO [StoreOpener-8f0200d3ef43a02efbc6267027b9c1a6-1] regionserver.HStore(310): Store=8f0200d3ef43a02efbc6267027b9c1a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:02:22,100 INFO [StoreOpener-a927bfc7816ed9c11c541458a68d27aa-1] regionserver.HStore(310): Store=a927bfc7816ed9c11c541458a68d27aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 04:02:22,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:22,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:22,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:02:22,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 04:02:22,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a927bfc7816ed9c11c541458a68d27aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74993220, jitterRate=0.11748605966567993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:02:22,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a927bfc7816ed9c11c541458a68d27aa: 2023-09-27 04:02:22,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8f0200d3ef43a02efbc6267027b9c1a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74605731, jitterRate=0.1117120236158371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 04:02:22,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8f0200d3ef43a02efbc6267027b9c1a6: 2023-09-27 04:02:22,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa., pid=109, masterSystemTime=1695787342088 2023-09-27 04:02:22,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a927bfc7816ed9c11c541458a68d27aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787342108"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787342108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787342108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787342108"}]},"ts":"1695787342108"} 2023-09-27 04:02:22,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6., pid=108, masterSystemTime=1695787342088 2023-09-27 04:02:22,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8f0200d3ef43a02efbc6267027b9c1a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787342111"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1695787342111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695787342111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695787342111"}]},"ts":"1695787342111"} 2023-09-27 04:02:22,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-27 04:02:22,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure a927bfc7816ed9c11c541458a68d27aa, server=jenkins-hbase17.apache.org,36187,1695787230796 in 173 msec 2023-09-27 04:02:22,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, ASSIGN in 334 msec 2023-09-27 04:02:22,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-27 04:02:22,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 8f0200d3ef43a02efbc6267027b9c1a6, server=jenkins-hbase17.apache.org,44775,1695787230832 in 176 msec 2023-09-27 04:02:22,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-27 04:02:22,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, ASSIGN in 335 msec 2023-09-27 04:02:22,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 04:02:22,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787342115"}]},"ts":"1695787342115"} 2023-09-27 04:02:22,116 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-27 04:02:22,117 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 04:02:22,118 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-27 04:02:22,119 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 04:02:22,120 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:22,120 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:22,120 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:22,120 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:22,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:22,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:22,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:22,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 04:02:22,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 390 msec 2023-09-27 04:02:22,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 04:02:22,340 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-27 04:02:22,342 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,342 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,344 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:02:22,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 04:02:22,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787342356 (current time:1695787342356). 2023-09-27 04:02:22,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:02:22,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x465f813b to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:22,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70c7bc96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:22,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:22,367 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:22,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x465f813b to 127.0.0.1:51909 2023-09-27 04:02:22,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:22,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x7637c471 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:22,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cdbd5d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:22,377 DEBUG [hconnection-0x1b5f3d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:22,381 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:22,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:22,394 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7637c471 to 127.0.0.1:51909 2023-09-27 04:02:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 04:02:22,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:02:22,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 04:02:22,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 04:02:22,399 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 04:02:22,400 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695787942400 2023-09-27 04:02:22,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 04:02:22,402 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:02:22,402 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:02:22,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 04:02:22,404 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 04:02:22,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-09-27 04:02:22,407 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 04:02:22,409 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695787942409 2023-09-27 04:02:22,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,421 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 04:02:22,421 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,423 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 04:02:22,423 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 04:02:22,423 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,423 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,426 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,426 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,426 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,426 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,427 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,427 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,427 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,427 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:02:22,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 04:02:22,428 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,428 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,428 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 04:02:22,430 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 04:02:22,430 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 04:02:22,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,430 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 04:02:22,430 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 04:02:22,430 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,430 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,432 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 04:02:22,433 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 04:02:22,433 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 04:02:22,433 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 04:02:22,433 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 04:02:22,433 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 04:02:22,434 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,434 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,435 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,435 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,435 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:22,435 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,435 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,435 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,435 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,436 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,436 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:22,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79767b2a[Count = 1] remaining members to acquire global barrier 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 04:02:22,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79767b2a[Count = 0] remaining members to acquire global barrier 2023-09-27 04:02:22,443 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 04:02:22,443 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 04:02:22,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,445 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,444 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,445 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. started... 2023-09-27 04:02:22,445 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 04:02:22,445 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 04:02:22,445 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 04:02:22,444 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:22,445 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:22,445 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:02:22,445 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,445 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:02:22,446 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 04:02:22,446 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:22,446 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 04:02:22,449 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:22,455 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a927bfc7816ed9c11c541458a68d27aa: 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. started... 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:02:22,455 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f0200d3ef43a02efbc6267027b9c1a6: 2023-09-27 04:02:22,456 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,456 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:22,456 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 04:02:22,485 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. completed. 2023-09-27 04:02:22,485 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,485 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:22,485 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:22,485 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,488 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 04:02:22,488 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:02:22,489 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 04:02:22,490 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:22,490 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 04:02:22,489 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,493 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. completed. 2023-09-27 04:02:22,493 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,493 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:22,493 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:22,493 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,493 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 04:02:22,493 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:02:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,494 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,494 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 04:02:22,494 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:22,494 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 04:02:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36187,1695787230796': 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:02:22,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 04:02:22,501 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 04:02:22,501 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:02:22,501 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:02:22,501 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,501 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:02:22,502 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,502 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,502 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:22,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,502 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:22,502 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:22,502 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,503 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:22,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,503 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,502 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 04:02:22,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:02:22,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:22,503 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:22,503 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:02:22,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,504 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,506 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,506 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,506 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,508 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,508 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,508 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,509 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:22,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:02:22,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:22,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:22,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,509 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,512 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:22,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 04:02:22,512 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,512 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,512 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:22,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:22,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:22,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:22,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 04:02:22,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,558 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695787342400Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695787342528 (+128 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695787342528Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695787342528Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695787342532 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695787342550 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695787342558 (+8 ms) 2023-09-27 04:02:22,561 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 04:02:22,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 159 msec 2023-09-27 04:02:22,704 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:22,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 04:02:22,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:02:22,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:02:22,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36187] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 04:02:22,716 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,716 DEBUG [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,716 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 04:02:22,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 04:02:22,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695787342733 (current time:1695787342733). 2023-09-27 04:02:22,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 04:02:22,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x77328f3f to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:22,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b7e95e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:22,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:22,747 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:22,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77328f3f to 127.0.0.1:51909 2023-09-27 04:02:22,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:22,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(139): Connect 0x73ad6884 to 127.0.0.1:51909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 04:02:22,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10854ab9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 04:02:22,765 DEBUG [hconnection-0x769ebcee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:22,772 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:22,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 04:02:22,779 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 04:02:22,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73ad6884 to 127.0.0.1:51909 2023-09-27 04:02:22,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:02:22,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 04:02:22,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 04:02:22,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 04:02:22,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 04:02:22,784 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 04:02:22,785 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695787942785 2023-09-27 04:02:22,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 04:02:22,787 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 04:02:22,788 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 04:02:22,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 04:02:22,789 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 04:02:22,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-09-27 04:02:22,792 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 04:02:22,793 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695787942793 2023-09-27 04:02:22,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,812 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 04:02:22,812 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,813 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 04:02:22,813 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 04:02:22,883 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,883 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,884 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,884 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,884 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,884 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:22,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,884 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:22,884 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,885 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,885 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 04:02:22,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 04:02:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 04:02:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,886 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 04:02:22,886 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 04:02:22,886 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,886 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 04:02:22,886 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,888 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:22,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 04:02:22,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 04:02:22,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,893 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 04:02:22,893 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 04:02:22,893 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38525,1695787230747' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 04:02:22,893 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 04:02:22,893 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 04:02:22,893 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 04:02:22,894 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 04:02:22,894 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 04:02:22,894 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 04:02:22,895 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 04:02:22,895 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 04:02:22,895 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 04:02:22,896 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,897 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,897 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,897 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,897 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:22,897 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,897 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36187,1695787230796' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 04:02:22,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b7ba61[Count = 1] remaining members to acquire global barrier 2023-09-27 04:02:22,903 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,903 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,903 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,903 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 04:02:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,44775,1695787230832' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 04:02:22,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b7ba61[Count = 0] remaining members to acquire global barrier 2023-09-27 04:02:22,905 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 04:02:22,905 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 04:02:22,906 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 04:02:22,906 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 04:02:22,906 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,38525,1695787230747' in zk 2023-09-27 04:02:22,906 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:22,906 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:22,906 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,906 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,907 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,907 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. started... 2023-09-27 04:02:22,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 04:02:22,907 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8f0200d3ef43a02efbc6267027b9c1a6 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-27 04:02:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 04:02:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 04:02:22,907 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,907 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 04:02:22,907 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,907 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. started... 2023-09-27 04:02:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 04:02:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:22,907 DEBUG [member: 'jenkins-hbase17.apache.org,38525,1695787230747' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 04:02:22,913 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a927bfc7816ed9c11c541458a68d27aa 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-27 04:02:22,939 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927512186aa89a14775a92904e984cb4855 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927512186aa89a14775a92904e984cb4855 2023-09-27 04:02:22,940 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309274887fd5959fb4285883945b75698f6f8 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309274887fd5959fb4285883945b75698f6f8 2023-09-27 04:02:22,953 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/.tmp/cf/b1ec2d59c5374f0cb7a6087ead61f3d1 2023-09-27 04:02:22,958 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/.tmp/cf/b1ec2d59c5374f0cb7a6087ead61f3d1 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf/b1ec2d59c5374f0cb7a6087ead61f3d1 2023-09-27 04:02:22,963 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf/b1ec2d59c5374f0cb7a6087ead61f3d1, entries=4, sequenceid=6, filesize=5.6 K 2023-09-27 04:02:22,964 INFO [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 8f0200d3ef43a02efbc6267027b9c1a6 in 57ms, sequenceid=6, compaction requested=false 2023-09-27 04:02:22,964 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 04:02:22,964 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8f0200d3ef43a02efbc6267027b9c1a6: 2023-09-27 04:02:22,965 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,965 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:22,965 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf/b1ec2d59c5374f0cb7a6087ead61f3d1] hfiles 2023-09-27 04:02:22,965 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf/b1ec2d59c5374f0cb7a6087ead61f3d1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,969 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/.tmp/cf/a39a8fa7815947219c667a24bac03512 2023-09-27 04:02:22,975 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/.tmp/cf/a39a8fa7815947219c667a24bac03512 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf/a39a8fa7815947219c667a24bac03512 2023-09-27 04:02:22,980 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf/a39a8fa7815947219c667a24bac03512, entries=46, sequenceid=6, filesize=13.2 K 2023-09-27 04:02:22,981 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. completed. 2023-09-27 04:02:22,981 INFO [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a927bfc7816ed9c11c541458a68d27aa in 74ms, sequenceid=6, compaction requested=false 2023-09-27 04:02:22,981 DEBUG [rs(jenkins-hbase17.apache.org,44775,1695787230832)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:22,983 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a927bfc7816ed9c11c541458a68d27aa: 2023-09-27 04:02:22,983 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:22,983 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:22,983 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,983 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 04:02:22,983 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,983 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,44775,1695787230832' in zk 2023-09-27 04:02:22,983 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 04:02:22,983 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf/a39a8fa7815947219c667a24bac03512] hfiles 2023-09-27 04:02:22,983 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf/a39a8fa7815947219c667a24bac03512 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,984 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,984 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 04:02:22,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:22,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:22,984 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:22,984 DEBUG [member: 'jenkins-hbase17.apache.org,44775,1695787230832' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 04:02:22,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:22,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:22,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,44775,1695787230832': 2023-09-27 04:02:22,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,44775,1695787230832' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 04:02:22,998 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. completed. 2023-09-27 04:02:22,998 DEBUG [rs(jenkins-hbase17.apache.org,36187,1695787230796)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:22,999 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 04:02:22,999 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 04:02:22,999 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:22,999 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 04:02:22,999 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36187,1695787230796' in zk 2023-09-27 04:02:23,000 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 04:02:23,000 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,000 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:23,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,000 DEBUG [member: 'jenkins-hbase17.apache.org,36187,1695787230796' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 04:02:23,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:23,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:23,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:23,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:23,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36187,1695787230796': 2023-09-27 04:02:23,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36187,1695787230796' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 04:02:23,005 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 04:02:23,005 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 04:02:23,005 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 04:02:23,005 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,005 INFO [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:23,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:23,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 04:02:23,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 04:02:23,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 04:02:23,007 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:23,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:23,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,007 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 04:02:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 04:02:23,009 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,009 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,009 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:23,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:23,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:23,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,011 DEBUG [(jenkins-hbase17.apache.org,43371,1695787229649)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,011 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:23,013 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 04:02:23,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 04:02:23,013 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:23,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:23,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:23,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 04:02:23,013 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 04:02:23,014 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:02:23,014 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:23,014 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,014 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:23,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:23,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 04:02:23,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 04:02:23,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309274887fd5959fb4285883945b75698f6f8, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927512186aa89a14775a92904e984cb4855] mob files 2023-09-27 04:02:23,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309274887fd5959fb4285883945b75698f6f8 2023-09-27 04:02:23,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927512186aa89a14775a92904e984cb4855 2023-09-27 04:02:23,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 04:02:23,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,057 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695787342786Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695787343020 (+234 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695787343020Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695787343020Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695787343030 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695787343046 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695787343057 (+11 ms) 2023-09-27 04:02:23,060 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 04:02:23,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 273 msec 2023-09-27 04:02:23,094 DEBUG [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 04:02:23,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 04:02:23,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 04:02:23,095 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095 2023-09-27 04:02:23,095 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39783, tgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095, rawTgtDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095, srcFsUri=hdfs://localhost:39783, srcDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:02:23,115 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05 2023-09-27 04:02:23,115 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-287400547_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,115 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39783, inputRoot=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05, snapshotDir=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-27 04:02:23,128 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:23,160 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:23,160 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:23,161 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:23,161 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,148 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-648694370793720158.jar 2023-09-27 04:02:24,149 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,149 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,205 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/hadoop-7243545372440599177.jar 2023-09-27 04:02:24,205 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,206 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,206 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,206 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,207 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,207 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 04:02:24,207 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 04:02:24,207 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 04:02:24,208 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 04:02:24,208 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 04:02:24,208 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 04:02:24,209 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 04:02:24,209 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 04:02:24,209 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 04:02:24,209 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 04:02:24,210 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 04:02:24,210 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:24,211 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:24,211 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:02:24,211 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:24,211 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 04:02:24,212 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:02:24,212 DEBUG [Listener at jenkins-hbase17.apache.org/37905] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 04:02:25,415 WARN [Listener at jenkins-hbase17.apache.org/37905] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 04:02:25,416 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-27 04:02:25,418 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-27 04:02:26,266 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:02:26,266 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 04:02:26,272 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0006_000001 (auth:SIMPLE) 2023-09-27 04:02:26,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0007_000001 (auth:SIMPLE) 2023-09-27 04:02:27,010 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:02:30,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0007_000001 (auth:SIMPLE) 2023-09-27 04:02:33,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0007_000001 (auth:SIMPLE) 2023-09-27 04:02:36,112 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0007_000001 (auth:SIMPLE) 2023-09-27 04:02:37,595 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 04:02:37,595 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 04:02:37,602 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,603 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 04:02:37,603 INFO [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 04:02:37,603 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,603 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 04:02:37,604 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 04:02:37,604 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_702402619_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,604 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 04:02:37,604 DEBUG [Listener at jenkins-hbase17.apache.org/37905] snapshot.TestExportSnapshot(367): hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/export-test/export-1695787343095/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 04:02:37,615 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787357620"}]},"ts":"1695787357620"} 2023-09-27 04:02:37,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 04:02:37,622 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-27 04:02:37,623 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-27 04:02:37,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, UNASSIGN}] 2023-09-27 04:02:37,626 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, UNASSIGN 2023-09-27 04:02:37,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, UNASSIGN 2023-09-27 04:02:37,627 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a927bfc7816ed9c11c541458a68d27aa, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:02:37,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=8f0200d3ef43a02efbc6267027b9c1a6, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:02:37,627 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787357627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787357627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787357627"}]},"ts":"1695787357627"} 2023-09-27 04:02:37,627 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787357627"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1695787357627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695787357627"}]},"ts":"1695787357627"} 2023-09-27 04:02:37,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 8f0200d3ef43a02efbc6267027b9c1a6, server=jenkins-hbase17.apache.org,44775,1695787230832}] 2023-09-27 04:02:37,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure a927bfc7816ed9c11c541458a68d27aa, server=jenkins-hbase17.apache.org,36187,1695787230796}] 2023-09-27 04:02:37,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 04:02:37,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:37,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8f0200d3ef43a02efbc6267027b9c1a6, disabling compactions & flushes 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a927bfc7816ed9c11c541458a68d27aa, disabling compactions & flushes 2023-09-27 04:02:37,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:37,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. after waiting 0 ms 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. after waiting 0 ms 2023-09-27 04:02:37,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:37,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:02:37,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:02:37,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:37,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:02:37,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6. 2023-09-27 04:02:37,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa. 2023-09-27 04:02:37,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8f0200d3ef43a02efbc6267027b9c1a6: 2023-09-27 04:02:37,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a927bfc7816ed9c11c541458a68d27aa: 2023-09-27 04:02:37,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:37,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:37,796 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=8f0200d3ef43a02efbc6267027b9c1a6, regionState=CLOSED 2023-09-27 04:02:37,796 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787357796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787357796"}]},"ts":"1695787357796"} 2023-09-27 04:02:37,797 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a927bfc7816ed9c11c541458a68d27aa, regionState=CLOSED 2023-09-27 04:02:37,797 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695787357797"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695787357797"}]},"ts":"1695787357797"} 2023-09-27 04:02:37,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-27 04:02:37,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 8f0200d3ef43a02efbc6267027b9c1a6, server=jenkins-hbase17.apache.org,44775,1695787230832 in 170 msec 2023-09-27 04:02:37,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-27 04:02:37,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure a927bfc7816ed9c11c541458a68d27aa, server=jenkins-hbase17.apache.org,36187,1695787230796 in 169 msec 2023-09-27 04:02:37,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8f0200d3ef43a02efbc6267027b9c1a6, UNASSIGN in 175 msec 2023-09-27 04:02:37,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-27 04:02:37,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a927bfc7816ed9c11c541458a68d27aa, UNASSIGN in 176 msec 2023-09-27 04:02:37,802 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695787357802"}]},"ts":"1695787357802"} 2023-09-27 04:02:37,803 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-27 04:02:37,804 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-27 04:02:37,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-09-27 04:02:37,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 04:02:37,924 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-27 04:02:37,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,927 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,928 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,930 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44775] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,931 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,932 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,931 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,932 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 04:02:37,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 04:02:37,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 04:02:37,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 04:02:37,933 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:37,933 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,934 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 04:02:37,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 04:02:37,937 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/recovered.edits] 2023-09-27 04:02:37,937 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf, FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/recovered.edits] 2023-09-27 04:02:37,940 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf/b1ec2d59c5374f0cb7a6087ead61f3d1 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/cf/b1ec2d59c5374f0cb7a6087ead61f3d1 2023-09-27 04:02:37,940 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf/a39a8fa7815947219c667a24bac03512 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/cf/a39a8fa7815947219c667a24bac03512 2023-09-27 04:02:37,945 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa/recovered.edits/9.seqid 2023-09-27 04:02:37,946 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/recovered.edits/9.seqid to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6/recovered.edits/9.seqid 2023-09-27 04:02:37,946 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a927bfc7816ed9c11c541458a68d27aa 2023-09-27 04:02:37,946 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8f0200d3ef43a02efbc6267027b9c1a6 2023-09-27 04:02:37,946 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 04:02:37,946 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 04:02:37,947 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-27 04:02:37,950 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309274887fd5959fb4285883945b75698f6f8 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309274887fd5959fb4285883945b75698f6f8 2023-09-27 04:02:37,952 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927512186aa89a14775a92904e984cb4855 to hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230927512186aa89a14775a92904e984cb4855 2023-09-27 04:02:37,952 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 04:02:37,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,957 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-27 04:02:37,963 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-27 04:02:37,964 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,964 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-27 04:02:37,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787357964"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:37,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695787357964"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:37,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 04:02:37,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8f0200d3ef43a02efbc6267027b9c1a6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695787341731.8f0200d3ef43a02efbc6267027b9c1a6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a927bfc7816ed9c11c541458a68d27aa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695787341731.a927bfc7816ed9c11c541458a68d27aa.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 04:02:37,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-27 04:02:37,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695787357972"}]},"ts":"9223372036854775807"} 2023-09-27 04:02:37,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-27 04:02:37,976 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:37,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 52 msec 2023-09-27 04:02:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 04:02:38,037 INFO [Listener at jenkins-hbase17.apache.org/37905] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-27 04:02:38,044 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 04:02:38,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:38,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 04:02:38,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43371] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 04:02:38,071 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=769 (was 767) Potentially hanging thread: IPC Client (788891943) connection to jenkins-hbase17.apache.org/136.243.18.41:39981 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-5336 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-549287944_1 at /127.0.0.1:55064 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:52122 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:57240 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_702402619_17 at /127.0.0.1:55094 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x198566fb-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=479 (was 490), ProcessCount=182 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=1089 (was 1856) 2023-09-27 04:02:38,071 WARN [Listener at jenkins-hbase17.apache.org/37905] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-09-27 04:02:38,072 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-27 04:02:38,086 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-27 04:02:42,300 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695787237352_0007_000001 (auth:SIMPLE) 2023-09-27 04:02:43,367 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 04:02:52,213 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-27 04:03:06,333 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 04:03:06,334 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-27 04:03:06,442 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-27 04:03:06,455 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-27 04:03:06,456 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 04:03:06,467 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-27 04:03:06,571 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 04:03:06,571 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-27 04:03:06,571 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-27 04:03:06,571 INFO [Listener at jenkins-hbase17.apache.org/37905] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-27 04:03:06,571 DEBUG [Listener at jenkins-hbase17.apache.org/37905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x551d4abf to 127.0.0.1:51909 2023-09-27 04:03:06,571 DEBUG [Listener at jenkins-hbase17.apache.org/37905] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,572 DEBUG [Listener at jenkins-hbase17.apache.org/37905] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-27 04:03:06,572 DEBUG [Listener at jenkins-hbase17.apache.org/37905] util.JVMClusterUtil(257): Found active master hash=840931915, stopped=false 2023-09-27 04:03:06,572 DEBUG [Listener at jenkins-hbase17.apache.org/37905] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:06,572 DEBUG [Listener at jenkins-hbase17.apache.org/37905] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 04:03:06,572 INFO [Listener at jenkins-hbase17.apache.org/37905] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:03:06,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 04:03:06,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 04:03:06,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 04:03:06,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 04:03:06,573 INFO [Listener at jenkins-hbase17.apache.org/37905] procedure2.ProcedureExecutor(628): Stopping 2023-09-27 04:03:06,573 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:03:06,574 DEBUG [Listener at jenkins-hbase17.apache.org/37905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34c21bf9 to 127.0.0.1:51909 2023-09-27 04:03:06,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:03:06,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:03:06,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:03:06,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 04:03:06,574 DEBUG [Listener at jenkins-hbase17.apache.org/37905] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,574 INFO [Listener at jenkins-hbase17.apache.org/37905] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,38525,1695787230747' ***** 2023-09-27 04:03:06,574 DEBUG [Listener at jenkins-hbase17.apache.org/37905] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:06,574 INFO [Listener at jenkins-hbase17.apache.org/37905] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 04:03:06,574 INFO [Listener at jenkins-hbase17.apache.org/37905] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,36187,1695787230796' ***** 2023-09-27 04:03:06,575 DEBUG [Listener at jenkins-hbase17.apache.org/37905] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:06,575 INFO [Listener at jenkins-hbase17.apache.org/37905] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 04:03:06,575 INFO [RS:0;jenkins-hbase17:38525] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 04:03:06,575 INFO [RS:1;jenkins-hbase17:36187] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 04:03:06,575 INFO [RS:0;jenkins-hbase17:38525] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 04:03:06,575 INFO [Listener at jenkins-hbase17.apache.org/37905] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,44775,1695787230832' ***** 2023-09-27 04:03:06,575 INFO [RS:0;jenkins-hbase17:38525] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 04:03:06,575 INFO [RS:1;jenkins-hbase17:36187] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 04:03:06,575 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 04:03:06,575 INFO [RS:1;jenkins-hbase17:36187] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 04:03:06,575 DEBUG [Listener at jenkins-hbase17.apache.org/37905] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:06,575 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(3305): Received CLOSE for db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:03:06,575 INFO [Listener at jenkins-hbase17.apache.org/37905] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 04:03:06,575 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:03:06,575 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 04:03:06,575 INFO [RS:2;jenkins-hbase17:44775] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 04:03:06,576 INFO [RS:2;jenkins-hbase17:44775] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 04:03:06,576 DEBUG [RS:1;jenkins-hbase17:36187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c47cadc to 127.0.0.1:51909 2023-09-27 04:03:06,576 INFO [RS:2;jenkins-hbase17:44775] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 04:03:06,576 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:03:06,576 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(3305): Received CLOSE for e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:03:06,576 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:03:06,576 DEBUG [RS:1;jenkins-hbase17:36187] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,577 DEBUG [RS:2;jenkins-hbase17:44775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bf5a3c6 to 127.0.0.1:51909 2023-09-27 04:03:06,579 INFO [RS:1;jenkins-hbase17:36187] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 04:03:06,580 INFO [RS:1;jenkins-hbase17:36187] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 04:03:06,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing db5d6a40ff4cdcd2b3037d9b242589c4, disabling compactions & flushes 2023-09-27 04:03:06,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e68891c228a7144b5752f01c0ef2f729, disabling compactions & flushes 2023-09-27 04:03:06,576 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 04:03:06,576 DEBUG [RS:0;jenkins-hbase17:38525] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a862769 to 127.0.0.1:51909 2023-09-27 04:03:06,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:03:06,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:03:06,580 INFO [RS:1;jenkins-hbase17:36187] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 04:03:06,579 DEBUG [RS:2;jenkins-hbase17:44775] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,580 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-27 04:03:06,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:03:06,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:03:06,580 DEBUG [RS:0;jenkins-hbase17:38525] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. after waiting 0 ms 2023-09-27 04:03:06,582 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 04:03:06,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. after waiting 0 ms 2023-09-27 04:03:06,583 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-27 04:03:06,581 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 04:03:06,583 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 04:03:06,583 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1478): Online Regions={e68891c228a7144b5752f01c0ef2f729=hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729.} 2023-09-27 04:03:06,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:03:06,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:03:06,582 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 04:03:06,582 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 04:03:06,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing e68891c228a7144b5752f01c0ef2f729 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-27 04:03:06,584 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1478): Online Regions={db5d6a40ff4cdcd2b3037d9b242589c4=hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4.} 2023-09-27 04:03:06,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing db5d6a40ff4cdcd2b3037d9b242589c4 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-27 04:03:06,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 04:03:06,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 04:03:06,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 04:03:06,584 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 04:03:06,584 DEBUG [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1504): Waiting on e68891c228a7144b5752f01c0ef2f729 2023-09-27 04:03:06,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-27 04:03:06,584 DEBUG [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1504): Waiting on db5d6a40ff4cdcd2b3037d9b242589c4 2023-09-27 04:03:06,585 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-27 04:03:06,591 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 04:03:06,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/.tmp/info/e92a04238dc24ccd8bb8d65b2a93e99f 2023-09-27 04:03:06,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/.tmp/info/8830532a4ee34ebd940e4deb640c094f 2023-09-27 04:03:06,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/.tmp/l/c4d900074006402ea2bd9536a0f0ea40 2023-09-27 04:03:06,630 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e92a04238dc24ccd8bb8d65b2a93e99f 2023-09-27 04:03:06,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4d900074006402ea2bd9536a0f0ea40 2023-09-27 04:03:06,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/.tmp/l/c4d900074006402ea2bd9536a0f0ea40 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/l/c4d900074006402ea2bd9536a0f0ea40 2023-09-27 04:03:06,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/.tmp/info/8830532a4ee34ebd940e4deb640c094f as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/info/8830532a4ee34ebd940e4deb640c094f 2023-09-27 04:03:06,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4d900074006402ea2bd9536a0f0ea40 2023-09-27 04:03:06,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/l/c4d900074006402ea2bd9536a0f0ea40, entries=7, sequenceid=18, filesize=5.2 K 2023-09-27 04:03:06,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e68891c228a7144b5752f01c0ef2f729 in 55ms, sequenceid=18, compaction requested=false 2023-09-27 04:03:06,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/info/8830532a4ee34ebd940e4deb640c094f, entries=2, sequenceid=6, filesize=4.8 K 2023-09-27 04:03:06,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for db5d6a40ff4cdcd2b3037d9b242589c4 in 60ms, sequenceid=6, compaction requested=false 2023-09-27 04:03:06,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/acl/e68891c228a7144b5752f01c0ef2f729/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-27 04:03:06,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:06,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:03:06,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e68891c228a7144b5752f01c0ef2f729: 2023-09-27 04:03:06,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695787233861.e68891c228a7144b5752f01c0ef2f729. 2023-09-27 04:03:06,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/namespace/db5d6a40ff4cdcd2b3037d9b242589c4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 04:03:06,670 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 04:03:06,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:06,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/.tmp/rep_barrier/e61eb292ea34424cb2da67049e46be8d 2023-09-27 04:03:06,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:03:06,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for db5d6a40ff4cdcd2b3037d9b242589c4: 2023-09-27 04:03:06,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695787233010.db5d6a40ff4cdcd2b3037d9b242589c4. 2023-09-27 04:03:06,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e61eb292ea34424cb2da67049e46be8d 2023-09-27 04:03:06,784 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,44775,1695787230832; all regions closed. 2023-09-27 04:03:06,785 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,38525,1695787230747; all regions closed. 2023-09-27 04:03:06,785 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-27 04:03:06,796 DEBUG [RS:2;jenkins-hbase17:44775] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs 2023-09-27 04:03:06,796 DEBUG [RS:0;jenkins-hbase17:38525] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs 2023-09-27 04:03:06,796 INFO [RS:2;jenkins-hbase17:44775] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C44775%2C1695787230832:(num 1695787232495) 2023-09-27 04:03:06,796 INFO [RS:0;jenkins-hbase17:38525] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C38525%2C1695787230747:(num 1695787232495) 2023-09-27 04:03:06,796 DEBUG [RS:2;jenkins-hbase17:44775] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,796 DEBUG [RS:0;jenkins-hbase17:38525] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:06,796 INFO [RS:2;jenkins-hbase17:44775] regionserver.LeaseManager(133): Closed leases 2023-09-27 04:03:06,796 INFO [RS:0;jenkins-hbase17:38525] regionserver.LeaseManager(133): Closed leases 2023-09-27 04:03:06,797 INFO [RS:0;jenkins-hbase17:38525] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 04:03:06,797 INFO [RS:2;jenkins-hbase17:44775] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 04:03:06,798 INFO [RS:0;jenkins-hbase17:38525] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 04:03:06,798 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 04:03:06,798 INFO [RS:2;jenkins-hbase17:44775] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 04:03:06,798 INFO [RS:2;jenkins-hbase17:44775] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 04:03:06,798 INFO [RS:2;jenkins-hbase17:44775] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 04:03:06,798 INFO [RS:0;jenkins-hbase17:38525] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 04:03:06,798 INFO [RS:0;jenkins-hbase17:38525] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 04:03:06,798 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 04:03:06,799 INFO [RS:2;jenkins-hbase17:44775] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:44775 2023-09-27 04:03:06,799 INFO [RS:0;jenkins-hbase17:38525] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38525 2023-09-27 04:03:06,804 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:03:06,804 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:03:06,804 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 04:03:06,805 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:03:06,804 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 04:03:06,804 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38525,1695787230747 2023-09-27 04:03:06,804 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 04:03:06,805 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 04:03:06,805 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:03:06,805 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,44775,1695787230832 2023-09-27 04:03:06,805 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,44775,1695787230832] 2023-09-27 04:03:06,806 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,44775,1695787230832; numProcessing=1 2023-09-27 04:03:06,806 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,44775,1695787230832 already deleted, retry=false 2023-09-27 04:03:06,806 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,44775,1695787230832 expired; onlineServers=2 2023-09-27 04:03:06,806 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,38525,1695787230747] 2023-09-27 04:03:06,806 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,38525,1695787230747; numProcessing=2 2023-09-27 04:03:06,807 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,38525,1695787230747 already deleted, retry=false 2023-09-27 04:03:06,807 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,38525,1695787230747 expired; onlineServers=1 2023-09-27 04:03:06,905 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:06,905 INFO [RS:0;jenkins-hbase17:38525] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,38525,1695787230747; zookeeper connection closed. 2023-09-27 04:03:06,905 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:38525-0x100eb89d9940001, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:06,906 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f3643c8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f3643c8 2023-09-27 04:03:06,985 DEBUG [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-27 04:03:07,005 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:07,005 INFO [RS:2;jenkins-hbase17:44775] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,44775,1695787230832; zookeeper connection closed. 2023-09-27 04:03:07,006 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:44775-0x100eb89d9940003, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:07,006 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f110a09] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f110a09 2023-09-27 04:03:07,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/.tmp/table/c075a4b20394448bb09204d4d20ee923 2023-09-27 04:03:07,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c075a4b20394448bb09204d4d20ee923 2023-09-27 04:03:07,097 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/.tmp/info/e92a04238dc24ccd8bb8d65b2a93e99f as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/info/e92a04238dc24ccd8bb8d65b2a93e99f 2023-09-27 04:03:07,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e92a04238dc24ccd8bb8d65b2a93e99f 2023-09-27 04:03:07,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/info/e92a04238dc24ccd8bb8d65b2a93e99f, entries=48, sequenceid=131, filesize=10.3 K 2023-09-27 04:03:07,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/.tmp/rep_barrier/e61eb292ea34424cb2da67049e46be8d as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/rep_barrier/e61eb292ea34424cb2da67049e46be8d 2023-09-27 04:03:07,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e61eb292ea34424cb2da67049e46be8d 2023-09-27 04:03:07,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/rep_barrier/e61eb292ea34424cb2da67049e46be8d, entries=13, sequenceid=131, filesize=6.4 K 2023-09-27 04:03:07,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/.tmp/table/c075a4b20394448bb09204d4d20ee923 as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/table/c075a4b20394448bb09204d4d20ee923 2023-09-27 04:03:07,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c075a4b20394448bb09204d4d20ee923 2023-09-27 04:03:07,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/table/c075a4b20394448bb09204d4d20ee923, entries=24, sequenceid=131, filesize=6.9 K 2023-09-27 04:03:07,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 536ms, sequenceid=131, compaction requested=false 2023-09-27 04:03:07,132 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-27 04:03:07,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 04:03:07,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 04:03:07,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 04:03:07,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 04:03:07,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-27 04:03:07,185 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,36187,1695787230796; all regions closed. 2023-09-27 04:03:07,193 DEBUG [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs 2023-09-27 04:03:07,193 INFO [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C36187%2C1695787230796.meta:.meta(num 1695787232725) 2023-09-27 04:03:07,207 DEBUG [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/oldWALs 2023-09-27 04:03:07,207 INFO [RS:1;jenkins-hbase17:36187] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C36187%2C1695787230796:(num 1695787232495) 2023-09-27 04:03:07,207 DEBUG [RS:1;jenkins-hbase17:36187] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:07,207 INFO [RS:1;jenkins-hbase17:36187] regionserver.LeaseManager(133): Closed leases 2023-09-27 04:03:07,208 INFO [RS:1;jenkins-hbase17:36187] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 04:03:07,208 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 04:03:07,209 INFO [RS:1;jenkins-hbase17:36187] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:36187 2023-09-27 04:03:07,210 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36187,1695787230796 2023-09-27 04:03:07,210 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 04:03:07,211 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,36187,1695787230796] 2023-09-27 04:03:07,211 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,36187,1695787230796; numProcessing=3 2023-09-27 04:03:07,212 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,36187,1695787230796 already deleted, retry=false 2023-09-27 04:03:07,212 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,36187,1695787230796 expired; onlineServers=0 2023-09-27 04:03:07,212 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,43371,1695787229649' ***** 2023-09-27 04:03:07,212 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-27 04:03:07,212 DEBUG [M:0;jenkins-hbase17:43371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73229070, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-27 04:03:07,212 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,43371,1695787229649 2023-09-27 04:03:07,212 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,43371,1695787229649; all regions closed. 2023-09-27 04:03:07,212 DEBUG [M:0;jenkins-hbase17:43371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 04:03:07,212 DEBUG [M:0;jenkins-hbase17:43371] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-27 04:03:07,212 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-27 04:03:07,212 DEBUG [M:0;jenkins-hbase17:43371] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-27 04:03:07,212 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1695787232152] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1695787232152,5,FailOnTimeoutGroup] 2023-09-27 04:03:07,212 INFO [M:0;jenkins-hbase17:43371] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-27 04:03:07,212 INFO [M:0;jenkins-hbase17:43371] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-27 04:03:07,213 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1695787232152] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1695787232152,5,FailOnTimeoutGroup] 2023-09-27 04:03:07,213 INFO [M:0;jenkins-hbase17:43371] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-09-27 04:03:07,213 DEBUG [M:0;jenkins-hbase17:43371] master.HMaster(1512): Stopping service threads 2023-09-27 04:03:07,213 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-27 04:03:07,213 INFO [M:0;jenkins-hbase17:43371] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-27 04:03:07,213 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 04:03:07,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 04:03:07,213 ERROR [M:0;jenkins-hbase17:43371] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-09-27 04:03:07,214 INFO [M:0;jenkins-hbase17:43371] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-27 04:03:07,214 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-27 04:03:07,214 DEBUG [M:0;jenkins-hbase17:43371] zookeeper.ZKUtil(398): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-27 04:03:07,214 WARN [M:0;jenkins-hbase17:43371] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-27 04:03:07,214 INFO [M:0;jenkins-hbase17:43371] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-27 04:03:07,214 INFO [M:0;jenkins-hbase17:43371] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-27 04:03:07,215 DEBUG [M:0;jenkins-hbase17:43371] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 04:03:07,215 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:03:07,215 DEBUG [M:0;jenkins-hbase17:43371] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:03:07,215 DEBUG [M:0;jenkins-hbase17:43371] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 04:03:07,215 DEBUG [M:0;jenkins-hbase17:43371] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:03:07,215 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.23 KB heapSize=452.45 KB 2023-09-27 04:03:07,234 INFO [M:0;jenkins-hbase17:43371] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.23 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c47633c740ec45fd911cb2e05fdc369c 2023-09-27 04:03:07,238 INFO [M:0;jenkins-hbase17:43371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c47633c740ec45fd911cb2e05fdc369c 2023-09-27 04:03:07,239 DEBUG [M:0;jenkins-hbase17:43371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c47633c740ec45fd911cb2e05fdc369c as hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c47633c740ec45fd911cb2e05fdc369c 2023-09-27 04:03:07,245 INFO [M:0;jenkins-hbase17:43371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c47633c740ec45fd911cb2e05fdc369c 2023-09-27 04:03:07,245 INFO [M:0;jenkins-hbase17:43371] regionserver.HStore(1080): Added hdfs://localhost:39783/user/jenkins/test-data/313a73bb-bfaa-a824-fb67-bd89fa01aa05/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c47633c740ec45fd911cb2e05fdc369c, entries=119, sequenceid=899, filesize=28.7 K 2023-09-27 04:03:07,246 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegion(2948): Finished flush of dataSize ~376.23 KB/385264, heapSize ~452.44 KB/463296, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-09-27 04:03:07,247 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 04:03:07,247 DEBUG [M:0;jenkins-hbase17:43371] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 04:03:07,255 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 04:03:07,255 INFO [M:0;jenkins-hbase17:43371] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-27 04:03:07,257 INFO [M:0;jenkins-hbase17:43371] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:43371 2023-09-27 04:03:07,258 DEBUG [M:0;jenkins-hbase17:43371] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,43371,1695787229649 already deleted, retry=false 2023-09-27 04:03:07,311 INFO [RS:1;jenkins-hbase17:36187] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,36187,1695787230796; zookeeper connection closed. 2023-09-27 04:03:07,311 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:07,311 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): regionserver:36187-0x100eb89d9940002, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:07,311 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@750b1c34] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@750b1c34 2023-09-27 04:03:07,312 INFO [Listener at jenkins-hbase17.apache.org/37905] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-27 04:03:07,411 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:07,411 INFO [M:0;jenkins-hbase17:43371] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,43371,1695787229649; zookeeper connection closed. 2023-09-27 04:03:07,411 DEBUG [Listener at localhost/39473-EventThread] zookeeper.ZKWatcher(600): master:43371-0x100eb89d9940000, quorum=127.0.0.1:51909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 04:03:07,413 WARN [Listener at jenkins-hbase17.apache.org/37905] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 04:03:07,416 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 04:03:07,437 WARN [BP-873239610-136.243.18.41-1695787226001 heartbeating to localhost/127.0.0.1:39783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-873239610-136.243.18.41-1695787226001 (Datanode Uuid b33c1893-1148-4ae1-8695-7d5215cd2c92) service to localhost/127.0.0.1:39783 2023-09-27 04:03:07,439 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data5/current/BP-873239610-136.243.18.41-1695787226001] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 04:03:07,439 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data6/current/BP-873239610-136.243.18.41-1695787226001] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 04:03:07,524 WARN [Listener at jenkins-hbase17.apache.org/37905] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 04:03:07,525 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 04:03:07,630 WARN [BP-873239610-136.243.18.41-1695787226001 heartbeating to localhost/127.0.0.1:39783] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 04:03:07,630 WARN [BP-873239610-136.243.18.41-1695787226001 heartbeating to localhost/127.0.0.1:39783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-873239610-136.243.18.41-1695787226001 (Datanode Uuid ab105f4b-59eb-4b4d-80a0-f4b5d2ecaaef) service to localhost/127.0.0.1:39783 2023-09-27 04:03:07,631 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data3/current/BP-873239610-136.243.18.41-1695787226001] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 04:03:07,632 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data4/current/BP-873239610-136.243.18.41-1695787226001] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 04:03:07,633 WARN [Listener at jenkins-hbase17.apache.org/37905] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 04:03:07,636 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 04:03:07,740 WARN [BP-873239610-136.243.18.41-1695787226001 heartbeating to localhost/127.0.0.1:39783] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 04:03:07,740 WARN [BP-873239610-136.243.18.41-1695787226001 heartbeating to localhost/127.0.0.1:39783] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-873239610-136.243.18.41-1695787226001 (Datanode Uuid 3da8c2f3-93e2-4caf-8a3d-bc9d006986a2) service to localhost/127.0.0.1:39783 2023-09-27 04:03:07,741 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data1/current/BP-873239610-136.243.18.41-1695787226001] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 04:03:07,741 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/365ec19f-f860-37a6-5015-561078a8c55f/cluster_0029ffec-2f3b-ab8b-e69c-9ed1e1b38fad/dfs/data/data2/current/BP-873239610-136.243.18.41-1695787226001] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 04:03:07,765 INFO [Listener at jenkins-hbase17.apache.org/37905] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 04:03:07,891 INFO [Listener at jenkins-hbase17.apache.org/37905] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-27 04:03:07,995 INFO [Listener at jenkins-hbase17.apache.org/37905] hbase.HBaseTestingUtility(1293): Minicluster is down