2023-07-19 14:10:09,852 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 14:10:10,094 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27 2023-07-19 14:10:10,095 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-19 14:10:10,140 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 14:10:10,361 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 14:10:10,362 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0, deleteOnExit=true 2023-07-19 14:10:10,362 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 14:10:10,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/test.cache.data in system properties and HBase conf 2023-07-19 14:10:10,363 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 14:10:10,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop.log.dir in system properties and HBase conf 2023-07-19 14:10:10,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 14:10:10,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 14:10:10,365 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 14:10:10,706 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 14:10:10,716 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:10,717 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:10,717 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 14:10:10,718 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:10,718 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 14:10:10,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 14:10:10,719 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:10,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:10,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 14:10:10,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/nfs.dump.dir in system properties and HBase conf 2023-07-19 14:10:10,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir in system properties and HBase conf 2023-07-19 14:10:10,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:10,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 14:10:10,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 14:10:11,380 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 14:10:11,384 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 14:10:11,656 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 14:10:11,816 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 14:10:11,836 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:11,883 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:11,924 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_localhost_38107_hdfs____.ueyc4j/webapp 2023-07-19 14:10:12,098 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38107 2023-07-19 14:10:12,135 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 14:10:12,136 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 14:10:12,634 WARN [Listener at localhost/35063] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:12,734 WARN [Listener at localhost/35063] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 14:10:12,761 WARN [Listener at localhost/35063] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:12,769 INFO [Listener at localhost/35063] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:12,780 INFO [Listener at localhost/35063] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_localhost_42615_datanode____.su6vzx/webapp 2023-07-19 14:10:12,920 INFO [Listener at localhost/35063] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42615 2023-07-19 14:10:13,457 WARN [Listener at localhost/45181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:13,509 WARN [Listener at localhost/45181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 14:10:13,514 WARN [Listener at localhost/45181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:13,517 INFO [Listener at localhost/45181] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:13,526 INFO [Listener at localhost/45181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_localhost_39615_datanode____vqlgnv/webapp 2023-07-19 14:10:13,661 INFO [Listener at localhost/45181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39615 2023-07-19 14:10:13,673 WARN [Listener at localhost/35025] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:13,698 WARN [Listener at localhost/35025] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 14:10:13,702 WARN [Listener at localhost/35025] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:13,704 INFO [Listener at localhost/35025] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:13,711 INFO [Listener at localhost/35025] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_localhost_42193_datanode____2er7zo/webapp 2023-07-19 14:10:13,869 INFO [Listener at localhost/35025] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42193 2023-07-19 14:10:13,883 WARN [Listener at localhost/33747] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 14:10:14,410 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x75f0c4e23255e8b2: Processing first storage report for DS-71e63324-49a4-484f-b216-e3a3484281c2 from datanode 6cc33ba1-256b-41f7-a53d-37b340636b21 2023-07-19 14:10:14,412 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x75f0c4e23255e8b2: from storage DS-71e63324-49a4-484f-b216-e3a3484281c2 node DatanodeRegistration(127.0.0.1:36301, datanodeUuid=6cc33ba1-256b-41f7-a53d-37b340636b21, infoPort=35029, infoSecurePort=0, ipcPort=35025, storageInfo=lv=-57;cid=testClusterID;nsid=1579261771;c=1689775811453), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,412 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a8f726c34587d5f: Processing first storage report for DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a from datanode 719159af-9750-47d4-aef9-8711bf05cb6b 2023-07-19 14:10:14,412 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a8f726c34587d5f: from storage DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a node DatanodeRegistration(127.0.0.1:45377, datanodeUuid=719159af-9750-47d4-aef9-8711bf05cb6b, infoPort=46397, infoSecurePort=0, ipcPort=45181, storageInfo=lv=-57;cid=testClusterID;nsid=1579261771;c=1689775811453), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,413 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x75f0c4e23255e8b2: Processing first storage report for DS-5cce97dc-5e03-4495-8351-da4b3daf9bf7 from datanode 6cc33ba1-256b-41f7-a53d-37b340636b21 2023-07-19 14:10:14,413 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x75f0c4e23255e8b2: from storage DS-5cce97dc-5e03-4495-8351-da4b3daf9bf7 node DatanodeRegistration(127.0.0.1:36301, datanodeUuid=6cc33ba1-256b-41f7-a53d-37b340636b21, infoPort=35029, infoSecurePort=0, ipcPort=35025, storageInfo=lv=-57;cid=testClusterID;nsid=1579261771;c=1689775811453), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,413 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a8f726c34587d5f: Processing first storage report for DS-c8677787-0be4-4802-bd79-3307101914eb from datanode 719159af-9750-47d4-aef9-8711bf05cb6b 2023-07-19 14:10:14,413 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a8f726c34587d5f: from storage DS-c8677787-0be4-4802-bd79-3307101914eb node DatanodeRegistration(127.0.0.1:45377, datanodeUuid=719159af-9750-47d4-aef9-8711bf05cb6b, infoPort=46397, infoSecurePort=0, ipcPort=45181, storageInfo=lv=-57;cid=testClusterID;nsid=1579261771;c=1689775811453), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,429 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde424fd4d16fc597: Processing first storage report for DS-3147c078-b408-4be9-b95d-d9ede13f580b from datanode c48d7029-eec5-4db1-8db9-0b85b8f8dea2 2023-07-19 14:10:14,429 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde424fd4d16fc597: from storage DS-3147c078-b408-4be9-b95d-d9ede13f580b node DatanodeRegistration(127.0.0.1:36347, datanodeUuid=c48d7029-eec5-4db1-8db9-0b85b8f8dea2, infoPort=42027, infoSecurePort=0, ipcPort=33747, storageInfo=lv=-57;cid=testClusterID;nsid=1579261771;c=1689775811453), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,430 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xde424fd4d16fc597: Processing first storage report for DS-cdc45f29-fb72-4903-9239-5768d4aa1777 from datanode c48d7029-eec5-4db1-8db9-0b85b8f8dea2 2023-07-19 14:10:14,430 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xde424fd4d16fc597: from storage DS-cdc45f29-fb72-4903-9239-5768d4aa1777 node DatanodeRegistration(127.0.0.1:36347, datanodeUuid=c48d7029-eec5-4db1-8db9-0b85b8f8dea2, infoPort=42027, infoSecurePort=0, ipcPort=33747, storageInfo=lv=-57;cid=testClusterID;nsid=1579261771;c=1689775811453), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 14:10:14,473 DEBUG [Listener at localhost/33747] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27 2023-07-19 14:10:14,561 INFO [Listener at localhost/33747] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/zookeeper_0, clientPort=58621, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 14:10:14,583 INFO [Listener at localhost/33747] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58621 2023-07-19 14:10:14,598 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:14,601 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:15,308 INFO [Listener at localhost/33747] util.FSUtils(471): Created version file at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 with version=8 2023-07-19 14:10:15,308 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/hbase-staging 2023-07-19 14:10:15,679 INFO [Listener at localhost/33747] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 14:10:16,316 INFO [Listener at localhost/33747] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:16,351 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,352 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,352 INFO [Listener at localhost/33747] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:16,352 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:16,352 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:16,513 INFO [Listener at localhost/33747] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:16,604 DEBUG [Listener at localhost/33747] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 14:10:16,715 INFO [Listener at localhost/33747] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35343 2023-07-19 14:10:16,734 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:16,737 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:16,763 INFO [Listener at localhost/33747] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35343 connecting to ZooKeeper ensemble=127.0.0.1:58621 2023-07-19 14:10:16,825 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:353430x0, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:16,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35343-0x1017deb3a8b0000 connected 2023-07-19 14:10:16,887 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:16,888 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:16,906 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:16,918 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35343 2023-07-19 14:10:16,918 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35343 2023-07-19 14:10:16,919 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35343 2023-07-19 14:10:16,919 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35343 2023-07-19 14:10:16,920 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35343 2023-07-19 14:10:16,928 INFO [Listener at localhost/33747] master.HMaster(444): hbase.rootdir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, hbase.cluster.distributed=false 2023-07-19 14:10:17,008 INFO [Listener at localhost/33747] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:17,008 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,009 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,009 INFO [Listener at localhost/33747] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:17,009 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,009 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:17,014 INFO [Listener at localhost/33747] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:17,019 INFO [Listener at localhost/33747] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41889 2023-07-19 14:10:17,021 INFO [Listener at localhost/33747] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 14:10:17,029 DEBUG [Listener at localhost/33747] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 14:10:17,031 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,033 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,036 INFO [Listener at localhost/33747] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41889 connecting to ZooKeeper ensemble=127.0.0.1:58621 2023-07-19 14:10:17,042 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:418890x0, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:17,043 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:418890x0, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:17,048 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:418890x0, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:17,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41889-0x1017deb3a8b0001 connected 2023-07-19 14:10:17,049 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:17,054 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41889 2023-07-19 14:10:17,054 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41889 2023-07-19 14:10:17,064 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41889 2023-07-19 14:10:17,067 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41889 2023-07-19 14:10:17,067 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41889 2023-07-19 14:10:17,080 INFO [Listener at localhost/33747] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:17,080 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,081 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,081 INFO [Listener at localhost/33747] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:17,082 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,082 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:17,082 INFO [Listener at localhost/33747] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:17,084 INFO [Listener at localhost/33747] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36051 2023-07-19 14:10:17,085 INFO [Listener at localhost/33747] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 14:10:17,086 DEBUG [Listener at localhost/33747] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 14:10:17,087 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,090 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,097 INFO [Listener at localhost/33747] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36051 connecting to ZooKeeper ensemble=127.0.0.1:58621 2023-07-19 14:10:17,102 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:360510x0, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:17,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36051-0x1017deb3a8b0002 connected 2023-07-19 14:10:17,106 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:17,108 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:17,109 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:17,109 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36051 2023-07-19 14:10:17,110 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36051 2023-07-19 14:10:17,110 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36051 2023-07-19 14:10:17,110 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36051 2023-07-19 14:10:17,114 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36051 2023-07-19 14:10:17,132 INFO [Listener at localhost/33747] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 14:10:17,132 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,132 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,132 INFO [Listener at localhost/33747] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 14:10:17,132 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 14:10:17,132 INFO [Listener at localhost/33747] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 14:10:17,133 INFO [Listener at localhost/33747] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 14:10:17,138 INFO [Listener at localhost/33747] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34059 2023-07-19 14:10:17,139 INFO [Listener at localhost/33747] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 14:10:17,141 DEBUG [Listener at localhost/33747] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 14:10:17,142 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,144 INFO [Listener at localhost/33747] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,145 INFO [Listener at localhost/33747] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34059 connecting to ZooKeeper ensemble=127.0.0.1:58621 2023-07-19 14:10:17,149 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:340590x0, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 14:10:17,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34059-0x1017deb3a8b0003 connected 2023-07-19 14:10:17,150 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:10:17,151 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:10:17,152 DEBUG [Listener at localhost/33747] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 14:10:17,156 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34059 2023-07-19 14:10:17,157 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34059 2023-07-19 14:10:17,157 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34059 2023-07-19 14:10:17,157 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34059 2023-07-19 14:10:17,158 DEBUG [Listener at localhost/33747] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34059 2023-07-19 14:10:17,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:17,173 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 14:10:17,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:17,201 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,201 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,201 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,201 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 14:10:17,202 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:17,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 14:10:17,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 14:10:17,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35343,1689775815498 from backup master directory 2023-07-19 14:10:17,211 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:17,211 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 14:10:17,211 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:17,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:17,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 14:10:17,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 14:10:17,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/hbase.id with ID: 81ae2648-6413-42c8-b291-8eed30d518d6 2023-07-19 14:10:17,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 14:10:17,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:17,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3be21830 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:17,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bba0447, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:17,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:17,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 14:10:17,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 14:10:17,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 14:10:17,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 14:10:17,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 14:10:17,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:17,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store-tmp 2023-07-19 14:10:17,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:17,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 14:10:17,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 14:10:17,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:10:17,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 14:10:17,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/WALs/jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:17,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35343%2C1689775815498, suffix=, logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/WALs/jenkins-hbase4.apache.org,35343,1689775815498, archiveDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/oldWALs, maxLogs=10 2023-07-19 14:10:17,833 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK] 2023-07-19 14:10:17,820 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK] 2023-07-19 14:10:17,833 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK] 2023-07-19 14:10:17,852 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 14:10:17,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/WALs/jenkins-hbase4.apache.org,35343,1689775815498/jenkins-hbase4.apache.org%2C35343%2C1689775815498.1689775817733 2023-07-19 14:10:17,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK], DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK], DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK]] 2023-07-19 14:10:17,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:17,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:17,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:17,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,077 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,085 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 14:10:18,115 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 14:10:18,129 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 14:10:18,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:18,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64510066, jitterRate=-0.0387251079082489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:18,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 14:10:18,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 14:10:18,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 14:10:18,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 14:10:18,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 14:10:18,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 14:10:18,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 39 msec 2023-07-19 14:10:18,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 14:10:18,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 14:10:18,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 14:10:18,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 14:10:18,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 14:10:18,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 14:10:18,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 14:10:18,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 14:10:18,356 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 14:10:18,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 14:10:18,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 14:10:18,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,383 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,383 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35343,1689775815498, sessionid=0x1017deb3a8b0000, setting cluster-up flag (Was=false) 2023-07-19 14:10:18,387 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 14:10:18,410 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 14:10:18,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:18,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:18,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 14:10:18,448 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:18,452 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp 2023-07-19 14:10:18,463 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(951): ClusterId : 81ae2648-6413-42c8-b291-8eed30d518d6 2023-07-19 14:10:18,470 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(951): ClusterId : 81ae2648-6413-42c8-b291-8eed30d518d6 2023-07-19 14:10:18,472 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(951): ClusterId : 81ae2648-6413-42c8-b291-8eed30d518d6 2023-07-19 14:10:18,488 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 14:10:18,489 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 14:10:18,488 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 14:10:18,496 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 14:10:18,496 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 14:10:18,496 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 14:10:18,496 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 14:10:18,501 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 14:10:18,501 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 14:10:18,503 DEBUG [RS:2;jenkins-hbase4:34059] zookeeper.ReadOnlyZKClient(139): Connect 0x46a56610 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:18,503 DEBUG [RS:0;jenkins-hbase4:41889] zookeeper.ReadOnlyZKClient(139): Connect 0x6fd3f98c to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:18,504 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 14:10:18,504 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 14:10:18,509 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 14:10:18,523 DEBUG [RS:1;jenkins-hbase4:36051] zookeeper.ReadOnlyZKClient(139): Connect 0x2364e6c3 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:18,548 DEBUG [RS:2;jenkins-hbase4:34059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@486280b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:18,551 DEBUG [RS:2;jenkins-hbase4:34059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c5d0d60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:10:18,590 DEBUG [RS:0;jenkins-hbase4:41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c7f9e0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:18,590 DEBUG [RS:0;jenkins-hbase4:41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@510a9385, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:10:18,591 DEBUG [RS:1;jenkins-hbase4:36051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bea7d10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:18,592 DEBUG [RS:1;jenkins-hbase4:36051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23d8c54b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:10:18,613 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34059 2023-07-19 14:10:18,614 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41889 2023-07-19 14:10:18,618 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36051 2023-07-19 14:10:18,621 INFO [RS:2;jenkins-hbase4:34059] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 14:10:18,621 INFO [RS:2;jenkins-hbase4:34059] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 14:10:18,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 14:10:18,622 INFO [RS:1;jenkins-hbase4:36051] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 14:10:18,625 INFO [RS:1;jenkins-hbase4:36051] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 14:10:18,622 INFO [RS:0;jenkins-hbase4:41889] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 14:10:18,626 INFO [RS:0;jenkins-hbase4:41889] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 14:10:18,626 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 14:10:18,626 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 14:10:18,626 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 14:10:18,628 INFO [RS:0;jenkins-hbase4:41889] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,629 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 14:10:18,629 INFO [RS:2;jenkins-hbase4:34059] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,629 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 14:10:18,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 14:10:18,628 INFO [RS:1;jenkins-hbase4:36051] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:18,631 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 14:10:18,634 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35343,1689775815498 with isa=jenkins-hbase4.apache.org/172.31.14.131:41889, startcode=1689775817007 2023-07-19 14:10:18,634 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35343,1689775815498 with isa=jenkins-hbase4.apache.org/172.31.14.131:36051, startcode=1689775817079 2023-07-19 14:10:18,640 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35343,1689775815498 with isa=jenkins-hbase4.apache.org/172.31.14.131:34059, startcode=1689775817131 2023-07-19 14:10:18,657 DEBUG [RS:0;jenkins-hbase4:41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 14:10:18,657 DEBUG [RS:1;jenkins-hbase4:36051] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 14:10:18,657 DEBUG [RS:2;jenkins-hbase4:34059] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 14:10:18,740 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50053, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 14:10:18,740 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33341, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 14:10:18,740 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37383, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 14:10:18,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 14:10:18,750 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35343] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 14:10:18,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 14:10:18,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 14:10:18,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:18,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:18,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:18,762 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35343] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 14:10:18,762 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35343] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 14:10:18,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689775848769 2023-07-19 14:10:18,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 14:10:18,777 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 14:10:18,778 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 14:10:18,784 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:18,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 14:10:18,793 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 14:10:18,794 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 14:10:18,794 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 14:10:18,794 WARN [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 14:10:18,794 WARN [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 14:10:18,798 WARN [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 14:10:18,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 14:10:18,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 14:10:18,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 14:10:18,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 14:10:18,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 14:10:18,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 14:10:18,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 14:10:18,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 14:10:18,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 14:10:18,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689775818826,5,FailOnTimeoutGroup] 2023-07-19 14:10:18,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689775818827,5,FailOnTimeoutGroup] 2023-07-19 14:10:18,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 14:10:18,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:18,865 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:18,866 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:18,866 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:18,895 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35343,1689775815498 with isa=jenkins-hbase4.apache.org/172.31.14.131:36051, startcode=1689775817079 2023-07-19 14:10:18,895 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35343,1689775815498 with isa=jenkins-hbase4.apache.org/172.31.14.131:41889, startcode=1689775817007 2023-07-19 14:10:18,896 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:18,900 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35343,1689775815498 with isa=jenkins-hbase4.apache.org/172.31.14.131:34059, startcode=1689775817131 2023-07-19 14:10:18,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 14:10:18,904 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35343] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:18,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/info 2023-07-19 14:10:18,908 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 14:10:18,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 14:10:18,911 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35343] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:18,913 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35343] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:18,914 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:18,914 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35063 2023-07-19 14:10:18,914 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 14:10:18,915 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:18,915 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35063 2023-07-19 14:10:18,915 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 14:10:18,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/rep_barrier 2023-07-19 14:10:18,916 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:18,916 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35063 2023-07-19 14:10:18,916 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 14:10:18,917 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 14:10:18,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 14:10:18,922 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/table 2023-07-19 14:10:18,923 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 14:10:18,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:18,938 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740 2023-07-19 14:10:18,940 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740 2023-07-19 14:10:18,945 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 14:10:18,948 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 14:10:18,957 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:18,958 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73532433, jitterRate=0.0957186371088028}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 14:10:18,958 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 14:10:18,958 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 14:10:18,958 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 14:10:18,959 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 14:10:18,959 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 14:10:18,959 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 14:10:18,960 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 14:10:18,961 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 14:10:18,970 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 14:10:18,970 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 14:10:18,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 14:10:18,998 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 14:10:19,002 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 14:10:19,021 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:10:19,154 DEBUG [jenkins-hbase4:35343] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 14:10:19,158 DEBUG [jenkins-hbase4:35343] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:19,163 DEBUG [jenkins-hbase4:35343] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:19,163 DEBUG [jenkins-hbase4:35343] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:19,163 DEBUG [jenkins-hbase4:35343] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:19,164 DEBUG [jenkins-hbase4:35343] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:19,166 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41889,1689775817007, state=OPENING 2023-07-19 14:10:19,209 DEBUG [RS:1;jenkins-hbase4:36051] zookeeper.ZKUtil(162): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,209 WARN [RS:1;jenkins-hbase4:36051] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:19,209 INFO [RS:1;jenkins-hbase4:36051] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,210 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,210 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41889,1689775817007] 2023-07-19 14:10:19,210 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36051,1689775817079] 2023-07-19 14:10:19,210 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34059,1689775817131] 2023-07-19 14:10:19,291 DEBUG [RS:0;jenkins-hbase4:41889] zookeeper.ZKUtil(162): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,291 DEBUG [RS:2;jenkins-hbase4:34059] zookeeper.ZKUtil(162): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,291 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 14:10:19,292 WARN [RS:2;jenkins-hbase4:34059] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:19,291 WARN [RS:0;jenkins-hbase4:41889] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 14:10:19,292 INFO [RS:2;jenkins-hbase4:34059] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,292 INFO [RS:0;jenkins-hbase4:41889] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,293 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,293 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,459 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:19,460 DEBUG [RS:1;jenkins-hbase4:36051] zookeeper.ZKUtil(162): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,460 DEBUG [RS:2;jenkins-hbase4:34059] zookeeper.ZKUtil(162): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,460 DEBUG [RS:0;jenkins-hbase4:41889] zookeeper.ZKUtil(162): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,460 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 14:10:19,461 DEBUG [RS:2;jenkins-hbase4:34059] zookeeper.ZKUtil(162): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,461 DEBUG [RS:1;jenkins-hbase4:36051] zookeeper.ZKUtil(162): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,461 DEBUG [RS:0;jenkins-hbase4:41889] zookeeper.ZKUtil(162): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,461 DEBUG [RS:1;jenkins-hbase4:36051] zookeeper.ZKUtil(162): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,462 DEBUG [RS:0;jenkins-hbase4:41889] zookeeper.ZKUtil(162): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,461 DEBUG [RS:2;jenkins-hbase4:34059] zookeeper.ZKUtil(162): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:10:19,477 DEBUG [RS:2;jenkins-hbase4:34059] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 14:10:19,477 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 14:10:19,477 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 14:10:19,490 INFO [RS:2;jenkins-hbase4:34059] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 14:10:19,491 INFO [RS:0;jenkins-hbase4:41889] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 14:10:19,492 INFO [RS:1;jenkins-hbase4:36051] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 14:10:19,520 INFO [RS:2;jenkins-hbase4:34059] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 14:10:19,527 INFO [RS:2;jenkins-hbase4:34059] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 14:10:19,527 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,522 INFO [RS:0;jenkins-hbase4:41889] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 14:10:19,530 INFO [RS:1;jenkins-hbase4:36051] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 14:10:19,531 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 14:10:19,531 INFO [RS:0;jenkins-hbase4:41889] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 14:10:19,532 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,532 INFO [RS:1;jenkins-hbase4:36051] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 14:10:19,532 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,532 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 14:10:19,533 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 14:10:19,542 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,542 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,542 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,542 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,542 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,543 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:19,544 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:19,544 DEBUG [RS:0;jenkins-hbase4:41889] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,545 DEBUG [RS:1;jenkins-hbase4:36051] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,544 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 14:10:19,545 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,545 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,545 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,546 DEBUG [RS:2;jenkins-hbase4:34059] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 14:10:19,550 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,551 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,551 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,556 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,557 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,557 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,577 INFO [RS:0;jenkins-hbase4:41889] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 14:10:19,580 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41889,1689775817007-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,580 INFO [RS:1;jenkins-hbase4:36051] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 14:10:19,584 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36051,1689775817079-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,595 INFO [RS:2;jenkins-hbase4:34059] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 14:10:19,595 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34059,1689775817131-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:19,625 INFO [RS:2;jenkins-hbase4:34059] regionserver.Replication(203): jenkins-hbase4.apache.org,34059,1689775817131 started 2023-07-19 14:10:19,625 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34059,1689775817131, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34059, sessionid=0x1017deb3a8b0003 2023-07-19 14:10:19,625 INFO [RS:0;jenkins-hbase4:41889] regionserver.Replication(203): jenkins-hbase4.apache.org,41889,1689775817007 started 2023-07-19 14:10:19,625 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41889,1689775817007, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41889, sessionid=0x1017deb3a8b0001 2023-07-19 14:10:19,626 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 14:10:19,626 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 14:10:19,626 DEBUG [RS:2;jenkins-hbase4:34059] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,630 INFO [RS:1;jenkins-hbase4:36051] regionserver.Replication(203): jenkins-hbase4.apache.org,36051,1689775817079 started 2023-07-19 14:10:19,626 DEBUG [RS:0;jenkins-hbase4:41889] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,631 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36051,1689775817079, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36051, sessionid=0x1017deb3a8b0002 2023-07-19 14:10:19,632 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 14:10:19,632 DEBUG [RS:1;jenkins-hbase4:36051] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,632 DEBUG [RS:1;jenkins-hbase4:36051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36051,1689775817079' 2023-07-19 14:10:19,632 DEBUG [RS:1;jenkins-hbase4:36051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 14:10:19,633 DEBUG [RS:1;jenkins-hbase4:36051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 14:10:19,634 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 14:10:19,634 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 14:10:19,634 DEBUG [RS:1;jenkins-hbase4:36051] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:19,634 DEBUG [RS:1;jenkins-hbase4:36051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36051,1689775817079' 2023-07-19 14:10:19,634 DEBUG [RS:1;jenkins-hbase4:36051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:19,631 DEBUG [RS:2;jenkins-hbase4:34059] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34059,1689775817131' 2023-07-19 14:10:19,635 DEBUG [RS:2;jenkins-hbase4:34059] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 14:10:19,635 DEBUG [RS:2;jenkins-hbase4:34059] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 14:10:19,631 DEBUG [RS:0;jenkins-hbase4:41889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41889,1689775817007' 2023-07-19 14:10:19,636 DEBUG [RS:1;jenkins-hbase4:36051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:19,636 DEBUG [RS:0;jenkins-hbase4:41889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 14:10:19,636 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 14:10:19,636 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 14:10:19,636 DEBUG [RS:2;jenkins-hbase4:34059] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:19,637 DEBUG [RS:2;jenkins-hbase4:34059] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34059,1689775817131' 2023-07-19 14:10:19,637 DEBUG [RS:1;jenkins-hbase4:36051] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 14:10:19,637 DEBUG [RS:0;jenkins-hbase4:41889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 14:10:19,637 INFO [RS:1;jenkins-hbase4:36051] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 14:10:19,637 DEBUG [RS:2;jenkins-hbase4:34059] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:19,638 INFO [RS:1;jenkins-hbase4:36051] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 14:10:19,639 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 14:10:19,639 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 14:10:19,639 DEBUG [RS:2;jenkins-hbase4:34059] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:19,639 DEBUG [RS:0;jenkins-hbase4:41889] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,639 DEBUG [RS:0;jenkins-hbase4:41889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41889,1689775817007' 2023-07-19 14:10:19,639 DEBUG [RS:0;jenkins-hbase4:41889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:19,639 DEBUG [RS:2;jenkins-hbase4:34059] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 14:10:19,640 INFO [RS:2;jenkins-hbase4:34059] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 14:10:19,640 DEBUG [RS:0;jenkins-hbase4:41889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:19,640 INFO [RS:2;jenkins-hbase4:34059] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 14:10:19,641 DEBUG [RS:0;jenkins-hbase4:41889] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 14:10:19,641 INFO [RS:0;jenkins-hbase4:41889] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 14:10:19,641 INFO [RS:0;jenkins-hbase4:41889] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 14:10:19,663 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:19,667 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:10:19,671 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:10:19,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 14:10:19,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 14:10:19,695 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41889%2C1689775817007.meta, suffix=.meta, logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,41889,1689775817007, archiveDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs, maxLogs=32 2023-07-19 14:10:19,719 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK] 2023-07-19 14:10:19,720 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK] 2023-07-19 14:10:19,721 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK] 2023-07-19 14:10:19,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,41889,1689775817007/jenkins-hbase4.apache.org%2C41889%2C1689775817007.meta.1689775819699.meta 2023-07-19 14:10:19,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK], DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK], DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK]] 2023-07-19 14:10:19,725 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:19,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 14:10:19,728 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:19,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 14:10:19,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 14:10:19,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 14:10:19,752 INFO [RS:2;jenkins-hbase4:34059] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34059%2C1689775817131, suffix=, logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,34059,1689775817131, archiveDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs, maxLogs=32 2023-07-19 14:10:19,755 INFO [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41889%2C1689775817007, suffix=, logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,41889,1689775817007, archiveDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs, maxLogs=32 2023-07-19 14:10:19,757 INFO [RS:1;jenkins-hbase4:36051] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36051%2C1689775817079, suffix=, logDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,36051,1689775817079, archiveDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs, maxLogs=32 2023-07-19 14:10:19,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 14:10:19,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:19,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 14:10:19,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 14:10:19,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 14:10:19,770 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/info 2023-07-19 14:10:19,772 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/info 2023-07-19 14:10:19,773 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 14:10:19,774 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:19,775 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 14:10:19,855 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/rep_barrier 2023-07-19 14:10:19,855 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/rep_barrier 2023-07-19 14:10:19,859 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 14:10:19,861 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:19,861 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 14:10:19,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/table 2023-07-19 14:10:19,864 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/table 2023-07-19 14:10:19,869 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 14:10:19,871 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK] 2023-07-19 14:10:19,872 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK] 2023-07-19 14:10:19,873 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK] 2023-07-19 14:10:19,874 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK] 2023-07-19 14:10:19,875 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK] 2023-07-19 14:10:19,875 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK] 2023-07-19 14:10:19,876 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK] 2023-07-19 14:10:19,876 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK] 2023-07-19 14:10:19,876 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK] 2023-07-19 14:10:19,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:19,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740 2023-07-19 14:10:19,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740 2023-07-19 14:10:19,898 INFO [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,41889,1689775817007/jenkins-hbase4.apache.org%2C41889%2C1689775817007.1689775819757 2023-07-19 14:10:19,899 DEBUG [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK], DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK], DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK]] 2023-07-19 14:10:19,900 INFO [RS:2;jenkins-hbase4:34059] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,34059,1689775817131/jenkins-hbase4.apache.org%2C34059%2C1689775817131.1689775819756 2023-07-19 14:10:19,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 14:10:19,903 DEBUG [RS:2;jenkins-hbase4:34059] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK], DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK], DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK]] 2023-07-19 14:10:19,912 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 14:10:19,914 INFO [RS:1;jenkins-hbase4:36051] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/WALs/jenkins-hbase4.apache.org,36051,1689775817079/jenkins-hbase4.apache.org%2C36051%2C1689775817079.1689775819759 2023-07-19 14:10:19,914 DEBUG [RS:1;jenkins-hbase4:36051] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36301,DS-71e63324-49a4-484f-b216-e3a3484281c2,DISK], DatanodeInfoWithStorage[127.0.0.1:36347,DS-3147c078-b408-4be9-b95d-d9ede13f580b,DISK], DatanodeInfoWithStorage[127.0.0.1:45377,DS-3b4e96ce-7f63-4724-a2be-2b0d3112731a,DISK]] 2023-07-19 14:10:19,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67593274, jitterRate=0.007218271493911743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 14:10:19,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 14:10:19,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689775819655 2023-07-19 14:10:20,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 14:10:20,006 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 14:10:20,006 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41889,1689775817007, state=OPEN 2023-07-19 14:10:20,028 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 14:10:20,028 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 14:10:20,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 14:10:20,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41889,1689775817007 in 563 msec 2023-07-19 14:10:20,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 14:10:20,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.0570 sec 2023-07-19 14:10:20,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4150 sec 2023-07-19 14:10:20,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689775820058, completionTime=-1 2023-07-19 14:10:20,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 14:10:20,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 14:10:20,127 DEBUG [hconnection-0x7c5859e3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:20,132 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:20,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 14:10:20,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689775880159 2023-07-19 14:10:20,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689775940160 2023-07-19 14:10:20,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 101 msec 2023-07-19 14:10:20,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35343,1689775815498-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35343,1689775815498-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35343,1689775815498-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35343, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 14:10:20,302 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 14:10:20,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 14:10:20,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:20,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 14:10:20,332 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:20,337 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:20,371 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,373 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f empty. 2023-07-19 14:10:20,374 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,375 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 14:10:20,438 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:20,441 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d9f9d7126a3a0efc50c94eb31c601b1f, NAME => 'hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:10:20,491 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d9f9d7126a3a0efc50c94eb31c601b1f, disabling compactions & flushes 2023-07-19 14:10:20,492 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. after waiting 0 ms 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,492 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,492 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d9f9d7126a3a0efc50c94eb31c601b1f: 2023-07-19 14:10:20,499 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:20,519 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689775820503"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775820503"}]},"ts":"1689775820503"} 2023-07-19 14:10:20,556 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 14:10:20,559 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:20,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775820559"}]},"ts":"1689775820559"} 2023-07-19 14:10:20,574 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 14:10:20,580 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:20,582 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:20,582 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:20,582 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:20,582 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:20,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d9f9d7126a3a0efc50c94eb31c601b1f, ASSIGN}] 2023-07-19 14:10:20,590 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d9f9d7126a3a0efc50c94eb31c601b1f, ASSIGN 2023-07-19 14:10:20,592 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d9f9d7126a3a0efc50c94eb31c601b1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:10:20,745 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 14:10:20,747 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d9f9d7126a3a0efc50c94eb31c601b1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:20,747 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689775820747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775820747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775820747"}]},"ts":"1689775820747"} 2023-07-19 14:10:20,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d9f9d7126a3a0efc50c94eb31c601b1f, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:10:20,927 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9f9d7126a3a0efc50c94eb31c601b1f, NAME => 'hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:20,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. service=AccessControlService 2023-07-19 14:10:20,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:20,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:20,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,934 INFO [StoreOpener-d9f9d7126a3a0efc50c94eb31c601b1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,943 DEBUG [StoreOpener-d9f9d7126a3a0efc50c94eb31c601b1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/info 2023-07-19 14:10:20,943 DEBUG [StoreOpener-d9f9d7126a3a0efc50c94eb31c601b1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/info 2023-07-19 14:10:20,944 INFO [StoreOpener-d9f9d7126a3a0efc50c94eb31c601b1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9f9d7126a3a0efc50c94eb31c601b1f columnFamilyName info 2023-07-19 14:10:20,945 INFO [StoreOpener-d9f9d7126a3a0efc50c94eb31c601b1f-1] regionserver.HStore(310): Store=d9f9d7126a3a0efc50c94eb31c601b1f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:20,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:10:20,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:20,960 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9f9d7126a3a0efc50c94eb31c601b1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63579987, jitterRate=-0.052584365010261536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:20,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9f9d7126a3a0efc50c94eb31c601b1f: 2023-07-19 14:10:20,965 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f., pid=6, masterSystemTime=1689775820915 2023-07-19 14:10:20,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:10:20,972 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d9f9d7126a3a0efc50c94eb31c601b1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:20,972 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689775820971"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775820971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775820971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775820971"}]},"ts":"1689775820971"} 2023-07-19 14:10:20,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 14:10:20,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d9f9d7126a3a0efc50c94eb31c601b1f, server=jenkins-hbase4.apache.org,41889,1689775817007 in 221 msec 2023-07-19 14:10:20,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 14:10:20,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d9f9d7126a3a0efc50c94eb31c601b1f, ASSIGN in 401 msec 2023-07-19 14:10:20,994 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:20,995 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775820995"}]},"ts":"1689775820995"} 2023-07-19 14:10:20,997 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 14:10:21,005 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:21,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 688 msec 2023-07-19 14:10:21,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 14:10:21,034 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 14:10:21,034 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:21,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 14:10:21,106 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 14:10:21,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 47 msec 2023-07-19 14:10:21,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 14:10:21,137 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 14:10:21,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-07-19 14:10:21,158 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 14:10:21,161 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 14:10:21,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.950sec 2023-07-19 14:10:21,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 14:10:21,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 14:10:21,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 14:10:21,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35343,1689775815498-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 14:10:21,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35343,1689775815498-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 14:10:21,180 DEBUG [Listener at localhost/33747] zookeeper.ReadOnlyZKClient(139): Connect 0x7d66cb3d to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:21,189 DEBUG [Listener at localhost/33747] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1380bdcf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:21,210 DEBUG [hconnection-0xad564e9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:21,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:21,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 14:10:21,222 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:21,227 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:21,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 14:10:21,234 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,235 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/acl/435f3294234ae2acd05812673d039929 empty. 2023-07-19 14:10:21,238 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,238 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:21,239 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 14:10:21,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,243 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:10:21,243 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 14:10:21,243 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/test.cache.data in system properties and HBase conf 2023-07-19 14:10:21,243 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop.log.dir in system properties and HBase conf 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 14:10:21,244 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 14:10:21,245 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/nfs.dump.dir in system properties and HBase conf 2023-07-19 14:10:21,246 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir in system properties and HBase conf 2023-07-19 14:10:21,246 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 14:10:21,246 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 14:10:21,246 INFO [Listener at localhost/33747] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 14:10:21,298 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:21,311 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 435f3294234ae2acd05812673d039929, NAME => 'hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:10:21,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,383 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:21,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 435f3294234ae2acd05812673d039929, disabling compactions & flushes 2023-07-19 14:10:21,385 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. after waiting 0 ms 2023-07-19 14:10:21,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,385 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,385 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 435f3294234ae2acd05812673d039929: 2023-07-19 14:10:21,390 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:21,392 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689775821392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775821392"}]},"ts":"1689775821392"} 2023-07-19 14:10:21,396 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 14:10:21,398 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:21,399 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775821398"}]},"ts":"1689775821398"} 2023-07-19 14:10:21,401 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 14:10:21,406 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:21,408 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:21,408 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:21,408 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:21,408 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:21,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN}] 2023-07-19 14:10:21,411 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN 2023-07-19 14:10:21,413 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:10:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,564 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 14:10:21,566 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=435f3294234ae2acd05812673d039929, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:21,566 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689775821566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775821566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775821566"}]},"ts":"1689775821566"} 2023-07-19 14:10:21,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 435f3294234ae2acd05812673d039929, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:10:21,731 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:21,731 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:10:21,738 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:10:21,747 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 435f3294234ae2acd05812673d039929, NAME => 'hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:10:21,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. service=AccessControlService 2023-07-19 14:10:21,748 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:21,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:21,749 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,749 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,755 INFO [StoreOpener-435f3294234ae2acd05812673d039929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,758 DEBUG [StoreOpener-435f3294234ae2acd05812673d039929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/l 2023-07-19 14:10:21,758 DEBUG [StoreOpener-435f3294234ae2acd05812673d039929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/l 2023-07-19 14:10:21,759 INFO [StoreOpener-435f3294234ae2acd05812673d039929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 435f3294234ae2acd05812673d039929 columnFamilyName l 2023-07-19 14:10:21,760 INFO [StoreOpener-435f3294234ae2acd05812673d039929-1] regionserver.HStore(310): Store=435f3294234ae2acd05812673d039929/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:21,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,766 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 435f3294234ae2acd05812673d039929 2023-07-19 14:10:21,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:21,801 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 435f3294234ae2acd05812673d039929; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66948040, jitterRate=-0.0023964643478393555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:21,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 435f3294234ae2acd05812673d039929: 2023-07-19 14:10:21,804 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929., pid=11, masterSystemTime=1689775821731 2023-07-19 14:10:21,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:10:21,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:21,848 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=435f3294234ae2acd05812673d039929, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:21,848 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689775821847"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775821847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775821847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775821847"}]},"ts":"1689775821847"} 2023-07-19 14:10:21,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 14:10:21,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 435f3294234ae2acd05812673d039929, server=jenkins-hbase4.apache.org,36051,1689775817079 in 280 msec 2023-07-19 14:10:21,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 14:10:21,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=435f3294234ae2acd05812673d039929, ASSIGN in 448 msec 2023-07-19 14:10:21,867 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:21,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775821867"}]},"ts":"1689775821867"} 2023-07-19 14:10:21,878 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 14:10:21,882 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:21,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 671 msec 2023-07-19 14:10:22,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 14:10:22,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 14:10:22,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 14:10:22,955 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:23,256 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:23,261 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38349_jobhistory____.jvi36s/webapp 2023-07-19 14:10:23,431 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 14:10:23,431 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:23,431 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:23,435 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:23,529 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:23,880 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:24,203 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 14:10:24,232 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38349 2023-07-19 14:10:24,448 WARN [Listener at jenkins-hbase4.apache.org/38461] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:24,822 WARN [Listener at jenkins-hbase4.apache.org/38461] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 14:10:24,826 INFO [Listener at jenkins-hbase4.apache.org/38461] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:24,838 INFO [Listener at jenkins-hbase4.apache.org/38461] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34003_cluster____adzxv6/webapp 2023-07-19 14:10:24,990 INFO [Listener at jenkins-hbase4.apache.org/38461] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:24,990 INFO [Listener at jenkins-hbase4.apache.org/38461] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 14:10:24,991 INFO [Listener at jenkins-hbase4.apache.org/38461] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:24,991 INFO [Listener at jenkins-hbase4.apache.org/38461] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:25,003 INFO [Listener at jenkins-hbase4.apache.org/38461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:25,243 INFO [Listener at jenkins-hbase4.apache.org/38461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:25,367 INFO [Listener at jenkins-hbase4.apache.org/38461] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:25,384 INFO [Listener at jenkins-hbase4.apache.org/38461] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34003 2023-07-19 14:10:25,419 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:10:25,592 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 14:10:25,594 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 14:10:25,595 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 14:10:25,675 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:25,676 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 14:10:25,676 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:25,676 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 14:10:25,679 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 14:10:25,679 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 14:10:25,679 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:25,679 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 14:10:25,679 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 14:10:25,679 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 14:10:26,064 WARN [Listener at jenkins-hbase4.apache.org/42515] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:26,105 WARN [Listener at jenkins-hbase4.apache.org/42515] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 14:10:26,106 INFO [Listener at jenkins-hbase4.apache.org/42515] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:26,130 INFO [Listener at jenkins-hbase4.apache.org/42515] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40313_node____6tsel3/webapp 2023-07-19 14:10:26,206 INFO [Listener at jenkins-hbase4.apache.org/42515] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 14:10:26,206 INFO [Listener at jenkins-hbase4.apache.org/42515] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:26,207 INFO [Listener at jenkins-hbase4.apache.org/42515] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:26,207 INFO [Listener at jenkins-hbase4.apache.org/42515] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:26,219 INFO [Listener at jenkins-hbase4.apache.org/42515] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,248 INFO [Listener at jenkins-hbase4.apache.org/42515] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,342 INFO [Listener at jenkins-hbase4.apache.org/42515] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,353 INFO [Listener at jenkins-hbase4.apache.org/42515] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40313 2023-07-19 14:10:26,632 WARN [Listener at jenkins-hbase4.apache.org/45907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 14:10:26,640 WARN [Listener at jenkins-hbase4.apache.org/45907] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 14:10:26,641 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 14:10:26,647 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44949_node____33xzjw/webapp 2023-07-19 14:10:26,711 INFO [Listener at jenkins-hbase4.apache.org/45907] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 14:10:26,711 INFO [Listener at jenkins-hbase4.apache.org/45907] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 14:10:26,712 INFO [Listener at jenkins-hbase4.apache.org/45907] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 14:10:26,712 INFO [Listener at jenkins-hbase4.apache.org/45907] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 14:10:26,720 INFO [Listener at jenkins-hbase4.apache.org/45907] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,739 INFO [Listener at jenkins-hbase4.apache.org/45907] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,819 INFO [Listener at jenkins-hbase4.apache.org/45907] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 14:10:26,828 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44949 2023-07-19 14:10:26,867 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 14:10:26,869 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:26,942 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=175, AvailableMemoryMB=4941 2023-07-19 14:10:26,942 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-07-19 14:10:26,959 DEBUG [Listener at jenkins-hbase4.apache.org/45907] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 14:10:26,965 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 14:10:26,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:26,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:26,976 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:26,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 14:10:26,978 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:26,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:26,984 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:26,984 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:26,985 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 empty. 2023-07-19 14:10:26,985 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba empty. 2023-07-19 14:10:26,986 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:26,990 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:26,990 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 14:10:27,021 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:27,022 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 40fa5fb7920e4b99b0e7dfda73f57c26, NAME => 'testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:10:27,023 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 94144d20ed222489f4e84e6623888fba, NAME => 'testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:10:27,047 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:27,048 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 40fa5fb7920e4b99b0e7dfda73f57c26, disabling compactions & flushes 2023-07-19 14:10:27,048 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,048 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,048 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. after waiting 0 ms 2023-07-19 14:10:27,048 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,049 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,049 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 40fa5fb7920e4b99b0e7dfda73f57c26: 2023-07-19 14:10:27,057 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:27,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 94144d20ed222489f4e84e6623888fba, disabling compactions & flushes 2023-07-19 14:10:27,058 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. after waiting 0 ms 2023-07-19 14:10:27,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,058 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,058 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 94144d20ed222489f4e84e6623888fba: 2023-07-19 14:10:27,062 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:27,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775827063"}]},"ts":"1689775827063"} 2023-07-19 14:10:27,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775827063"}]},"ts":"1689775827063"} 2023-07-19 14:10:27,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:27,109 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:10:27,110 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:27,111 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775827110"}]},"ts":"1689775827110"} 2023-07-19 14:10:27,113 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 14:10:27,118 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:27,121 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:27,121 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:27,121 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:27,121 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:27,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, ASSIGN}] 2023-07-19 14:10:27,124 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, ASSIGN 2023-07-19 14:10:27,124 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, ASSIGN 2023-07-19 14:10:27,125 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:10:27,125 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:10:27,276 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:10:27,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=40fa5fb7920e4b99b0e7dfda73f57c26, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,278 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=94144d20ed222489f4e84e6623888fba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775827278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775827278"}]},"ts":"1689775827278"} 2023-07-19 14:10:27,278 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775827278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775827278"}]},"ts":"1689775827278"} 2023-07-19 14:10:27,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 40fa5fb7920e4b99b0e7dfda73f57c26, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:10:27,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:27,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 94144d20ed222489f4e84e6623888fba, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:10:27,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40fa5fb7920e4b99b0e7dfda73f57c26, NAME => 'testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:10:27,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. service=AccessControlService 2023-07-19 14:10:27,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:27,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:27,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,446 INFO [StoreOpener-40fa5fb7920e4b99b0e7dfda73f57c26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,448 DEBUG [StoreOpener-40fa5fb7920e4b99b0e7dfda73f57c26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf 2023-07-19 14:10:27,448 DEBUG [StoreOpener-40fa5fb7920e4b99b0e7dfda73f57c26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf 2023-07-19 14:10:27,449 INFO [StoreOpener-40fa5fb7920e4b99b0e7dfda73f57c26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40fa5fb7920e4b99b0e7dfda73f57c26 columnFamilyName cf 2023-07-19 14:10:27,449 INFO [StoreOpener-40fa5fb7920e4b99b0e7dfda73f57c26-1] regionserver.HStore(310): Store=40fa5fb7920e4b99b0e7dfda73f57c26/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:27,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94144d20ed222489f4e84e6623888fba, NAME => 'testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:10:27,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. service=AccessControlService 2023-07-19 14:10:27,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:27,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:27,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:27,461 INFO [StoreOpener-94144d20ed222489f4e84e6623888fba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:27,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 40fa5fb7920e4b99b0e7dfda73f57c26; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67174032, jitterRate=9.710788726806641E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:27,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 40fa5fb7920e4b99b0e7dfda73f57c26: 2023-07-19 14:10:27,467 DEBUG [StoreOpener-94144d20ed222489f4e84e6623888fba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf 2023-07-19 14:10:27,467 DEBUG [StoreOpener-94144d20ed222489f4e84e6623888fba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf 2023-07-19 14:10:27,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26., pid=15, masterSystemTime=1689775827434 2023-07-19 14:10:27,468 INFO [StoreOpener-94144d20ed222489f4e84e6623888fba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94144d20ed222489f4e84e6623888fba columnFamilyName cf 2023-07-19 14:10:27,469 INFO [StoreOpener-94144d20ed222489f4e84e6623888fba-1] regionserver.HStore(310): Store=94144d20ed222489f4e84e6623888fba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:27,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=40fa5fb7920e4b99b0e7dfda73f57c26, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,480 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827471"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775827471"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775827471"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775827471"}]},"ts":"1689775827471"} 2023-07-19 14:10:27,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:27,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-19 14:10:27,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 40fa5fb7920e4b99b0e7dfda73f57c26, server=jenkins-hbase4.apache.org,36051,1689775817079 in 202 msec 2023-07-19 14:10:27,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:27,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94144d20ed222489f4e84e6623888fba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59047824, jitterRate=-0.12011885643005371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:27,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94144d20ed222489f4e84e6623888fba: 2023-07-19 14:10:27,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, ASSIGN in 371 msec 2023-07-19 14:10:27,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba., pid=16, masterSystemTime=1689775827435 2023-07-19 14:10:27,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=94144d20ed222489f4e84e6623888fba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,499 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775827499"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775827499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775827499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775827499"}]},"ts":"1689775827499"} 2023-07-19 14:10:27,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-19 14:10:27,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 94144d20ed222489f4e84e6623888fba, server=jenkins-hbase4.apache.org,41889,1689775817007 in 218 msec 2023-07-19 14:10:27,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-19 14:10:27,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, ASSIGN in 383 msec 2023-07-19 14:10:27,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:27,509 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775827509"}]},"ts":"1689775827509"} 2023-07-19 14:10:27,511 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 14:10:27,513 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:27,518 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 14:10:27,523 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:27,526 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:27,529 DEBUG [hconnection-0x48711c87-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:27,531 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-19 14:10:27,539 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 14:10:27,570 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,571 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,571 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,571 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:10:27,571 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:27,578 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:27,578 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:27,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:27,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 608 msec 2023-07-19 14:10:27,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 14:10:27,585 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 14:10:27,585 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-19 14:10:27,586 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:27,590 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-19 14:10:27,590 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:27,590 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-19 14:10:27,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:27,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775827605 (current time:1689775827605). 2023-07-19 14:10:27,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:27,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x17993b7a to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:27,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@705a941c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:27,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:27,617 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:27,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17993b7a to 127.0.0.1:58621 2023-07-19 14:10:27,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:27,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x25b0513f to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:27,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f36b84e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:27,636 DEBUG [hconnection-0x75b22fda-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:27,637 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:27,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:27,643 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:27,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25b0513f to 127.0.0.1:58621 2023-07-19 14:10:27,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:27,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 14:10:27,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:27,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:27,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:27,696 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:27,697 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689776427697 2023-07-19 14:10:27,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:27,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 14:10:27,701 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:27,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:27,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-19 14:10:27,705 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:27,705 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:27,706 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:27,706 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689776427706 2023-07-19 14:10:27,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,736 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 14:10:27,736 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:27,737 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 14:10:27,737 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 14:10:27,738 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,738 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,749 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:27,749 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:27,749 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:27,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:27,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:27,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:27,749 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,750 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,750 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,751 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,751 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:27,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:27,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:27,756 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:27,758 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:27,758 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:27,758 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:27,761 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,761 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:27,762 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:27,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:27,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9b2b921[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:27,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:27,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:27,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:27,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:27,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9b2b921[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:27,771 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 14:10:27,772 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,774 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,774 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,774 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:27,775 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:10:27,775 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:27,776 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:27,776 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:27,784 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:27,784 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:27,786 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. started... 2023-07-19 14:10:27,786 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:27,786 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. started... 2023-07-19 14:10:27,788 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94144d20ed222489f4e84e6623888fba: 2023-07-19 14:10:27,788 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40fa5fb7920e4b99b0e7dfda73f57c26: 2023-07-19 14:10:27,789 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,789 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:27,795 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:27,795 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:27,798 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:27,798 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:27,806 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:27,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:27,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:27,811 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:28,013 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:28,015 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:10:28,239 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. completed. 2023-07-19 14:10:28,240 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:28,240 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. completed. 2023-07-19 14:10:28,240 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:28,240 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:28,240 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:28,240 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,240 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,240 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:10:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:10:28,244 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,244 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,244 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,244 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:10:28,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 14:10:28,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:10:28,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 14:10:28,260 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 14:10:28,260 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:28,260 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:28,260 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,260 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:28,263 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,263 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,263 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,263 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,263 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,263 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,264 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,264 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,265 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,266 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,268 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,269 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,269 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,286 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,286 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,289 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,289 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,289 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,289 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,289 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:28,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:28,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:28,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,315 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:28,317 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 14:10:28,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 14:10:28,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,816 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:28,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689775827697Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689775828287 (+590 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689775828287Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689775828310 (+23 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689775828334 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689775828815 (+481 ms) 2023-07-19 14:10:28,817 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:28,818 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:28,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:28,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.1190 sec 2023-07-19 14:10:28,840 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,847 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:28,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36051] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:28,862 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 14:10:28,863 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:28,865 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:28,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775828900 (current time:1689775828900). 2023-07-19 14:10:28,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:28,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x52ffdbcc to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:28,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c102c1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:28,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,911 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ffdbcc to 127.0.0.1:58621 2023-07-19 14:10:28,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:28,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x4f12eb0f to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:28,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@639f789a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:28,920 DEBUG [hconnection-0x1e92e80f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,923 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:28,930 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f12eb0f to 127.0.0.1:58621 2023-07-19 14:10:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:28,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 14:10:28,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:28,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,936 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,937 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689776428937 2023-07-19 14:10:28,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 14:10:28,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 14:10:28,939 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:28,939 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:28,940 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 14:10:28,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-19 14:10:28,942 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:28,943 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689776428943 2023-07-19 14:10:28,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 14:10:28,958 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 14:10:28,959 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,959 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 14:10:28,959 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 14:10:28,960 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,960 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,961 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,961 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,961 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,961 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:28,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:28,962 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,962 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,963 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 14:10:28,963 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 14:10:28,964 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,964 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 14:10:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 14:10:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 14:10:28,969 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,969 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,970 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,972 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,972 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20554f5[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 14:10:28,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20554f5[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:28,977 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 14:10:28,977 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:28,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:28,981 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,982 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 14:10:28,981 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:28,981 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:28,982 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:28,982 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:28,982 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. started... 2023-07-19 14:10:28,982 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. started... 2023-07-19 14:10:28,982 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:28,982 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:28,982 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:28,982 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 40fa5fb7920e4b99b0e7dfda73f57c26 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 14:10:28,982 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 94144d20ed222489f4e84e6623888fba 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 14:10:28,982 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:28,982 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:10:28,985 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:28,985 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:28,985 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:29,039 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:29,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:29,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:29,041 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:29,074 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/.tmp/cf/24ac7417e79847f3a678dd2c18a0b179 2023-07-19 14:10:29,074 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/.tmp/cf/eba5a4f38dbc498e82e4b79832cdfbba 2023-07-19 14:10:29,128 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/.tmp/cf/24ac7417e79847f3a678dd2c18a0b179 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf/24ac7417e79847f3a678dd2c18a0b179 2023-07-19 14:10:29,128 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/.tmp/cf/eba5a4f38dbc498e82e4b79832cdfbba as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf/eba5a4f38dbc498e82e4b79832cdfbba 2023-07-19 14:10:29,137 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf/eba5a4f38dbc498e82e4b79832cdfbba, entries=48, sequenceid=6, filesize=8.1 K 2023-07-19 14:10:29,139 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf/24ac7417e79847f3a678dd2c18a0b179, entries=2, sequenceid=6, filesize=5.0 K 2023-07-19 14:10:29,142 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 94144d20ed222489f4e84e6623888fba in 160ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:29,142 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 14:10:29,143 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 40fa5fb7920e4b99b0e7dfda73f57c26 in 161ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:29,143 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 14:10:29,145 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40fa5fb7920e4b99b0e7dfda73f57c26: 2023-07-19 14:10:29,145 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94144d20ed222489f4e84e6623888fba: 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf/24ac7417e79847f3a678dd2c18a0b179] hfiles 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf/24ac7417e79847f3a678dd2c18a0b179 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf/eba5a4f38dbc498e82e4b79832cdfbba] hfiles 2023-07-19 14:10:29,146 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf/eba5a4f38dbc498e82e4b79832cdfbba for snapshot=snaptb0-testExportWithTargetName 2023-07-19 14:10:29,182 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. completed. 2023-07-19 14:10:29,182 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:29,183 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:29,183 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:29,183 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,183 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:29,183 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:10:29,185 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,185 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:29,185 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:29,185 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:29,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:29,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,189 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. completed. 2023-07-19 14:10:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,189 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 14:10:29,189 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:10:29,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,192 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,193 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 14:10:29,193 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:29,193 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 14:10:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:29,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:10:29,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 14:10:29,202 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 14:10:29,202 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:29,202 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:29,202 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 14:10:29,202 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:29,205 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,206 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,206 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,206 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:29,209 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,210 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:29,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 14:10:29,220 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,221 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,222 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,241 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:29,242 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:29,242 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:29,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:29,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:29,242 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:29,242 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 14:10:29,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 14:10:29,244 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:29,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:29,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,245 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:10:29,242 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,242 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,242 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:29,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:29,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:29,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:29,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,246 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:29,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:29,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:29,247 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,247 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:29,247 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:29,247 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,247 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 14:10:29,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,384 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 14:10:29,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689775828937Consolidate snapshot: snaptb0-testExportWithTargetName at 1689775829243 (+306 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689775829243Writing data manifest for snaptb0-testExportWithTargetName at 1689775829255 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689775829294 (+39 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689775829383 (+89 ms) 2023-07-19 14:10:29,386 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 14:10:29,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 448 msec 2023-07-19 14:10:29,545 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:29,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 14:10:29,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:29,549 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549 2023-07-19 14:10:29,549 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35063, tgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549, rawTgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:29,589 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:29,590 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1762362277_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 14:10:29,590 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 14:10:29,606 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 14:10:29,705 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,705 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,706 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,706 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,710 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,710 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,711 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,824 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-2796900103440964369.jar 2023-07-19 14:10:29,825 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,826 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,827 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,827 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,828 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,829 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:29,829 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:10:29,830 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:10:29,831 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:10:29,832 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:10:29,833 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:10:29,834 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:10:29,834 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:10:29,835 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:10:29,836 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:10:29,836 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:10:29,841 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,841 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,842 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:29,842 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,843 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:29,843 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:29,844 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:31,037 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:10:31,044 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 14:10:31,053 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 14:10:31,588 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:31,590 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:32,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:32,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:10:37,540 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:39,789 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:42,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:43,985 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:10:43,989 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:10:43,996 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 14:10:43,997 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:10:43,997 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:10:43,997 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 14:10:43,998 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 14:10:43,998 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 14:10:43,998 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549/.hbase-snapshot/testExportWithTargetName 2023-07-19 14:10:43,999 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 14:10:43,999 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775829549/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 14:10:44,010 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 14:10:44,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 14:10:44,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,028 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775844028"}]},"ts":"1689775844028"} 2023-07-19 14:10:44,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 14:10:44,030 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 14:10:44,032 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 14:10:44,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, UNASSIGN}] 2023-07-19 14:10:44,036 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, UNASSIGN 2023-07-19 14:10:44,036 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, UNASSIGN 2023-07-19 14:10:44,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=94144d20ed222489f4e84e6623888fba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:44,037 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=40fa5fb7920e4b99b0e7dfda73f57c26, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:44,037 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775844037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775844037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775844037"}]},"ts":"1689775844037"} 2023-07-19 14:10:44,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775844037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775844037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775844037"}]},"ts":"1689775844037"} 2023-07-19 14:10:44,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 94144d20ed222489f4e84e6623888fba, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:10:44,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 40fa5fb7920e4b99b0e7dfda73f57c26, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:10:44,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 14:10:44,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:44,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94144d20ed222489f4e84e6623888fba, disabling compactions & flushes 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 40fa5fb7920e4b99b0e7dfda73f57c26, disabling compactions & flushes 2023-07-19 14:10:44,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:44,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. after waiting 0 ms 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. after waiting 0 ms 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:44,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:10:44,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:10:44,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:44,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:10:44,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26. 2023-07-19 14:10:44,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba. 2023-07-19 14:10:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 40fa5fb7920e4b99b0e7dfda73f57c26: 2023-07-19 14:10:44,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94144d20ed222489f4e84e6623888fba: 2023-07-19 14:10:44,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:44,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=40fa5fb7920e4b99b0e7dfda73f57c26, regionState=CLOSED 2023-07-19 14:10:44,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:44,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775844222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775844222"}]},"ts":"1689775844222"} 2023-07-19 14:10:44,223 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=94144d20ed222489f4e84e6623888fba, regionState=CLOSED 2023-07-19 14:10:44,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689775844223"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775844223"}]},"ts":"1689775844223"} 2023-07-19 14:10:44,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 14:10:44,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 40fa5fb7920e4b99b0e7dfda73f57c26, server=jenkins-hbase4.apache.org,36051,1689775817079 in 184 msec 2023-07-19 14:10:44,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 14:10:44,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 94144d20ed222489f4e84e6623888fba, server=jenkins-hbase4.apache.org,41889,1689775817007 in 185 msec 2023-07-19 14:10:44,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=40fa5fb7920e4b99b0e7dfda73f57c26, UNASSIGN in 193 msec 2023-07-19 14:10:44,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-19 14:10:44,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=94144d20ed222489f4e84e6623888fba, UNASSIGN in 194 msec 2023-07-19 14:10:44,231 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775844231"}]},"ts":"1689775844231"} 2023-07-19 14:10:44,233 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 14:10:44,234 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 14:10:44,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-07-19 14:10:44,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 14:10:44,332 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 14:10:44,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 14:10:44,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,347 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 14:10:44,349 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,353 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 14:10:44,355 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:44,356 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:44,356 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,356 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,356 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,356 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 14:10:44,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 14:10:44,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 14:10:44,357 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:44,358 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:44,361 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/recovered.edits] 2023-07-19 14:10:44,361 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/recovered.edits] 2023-07-19 14:10:44,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 14:10:44,369 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf/24ac7417e79847f3a678dd2c18a0b179 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/cf/24ac7417e79847f3a678dd2c18a0b179 2023-07-19 14:10:44,369 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf/eba5a4f38dbc498e82e4b79832cdfbba to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/cf/eba5a4f38dbc498e82e4b79832cdfbba 2023-07-19 14:10:44,373 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26/recovered.edits/9.seqid 2023-07-19 14:10:44,373 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba/recovered.edits/9.seqid 2023-07-19 14:10:44,374 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/40fa5fb7920e4b99b0e7dfda73f57c26 2023-07-19 14:10:44,374 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportWithTargetName/94144d20ed222489f4e84e6623888fba 2023-07-19 14:10:44,374 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 14:10:44,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,404 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 14:10:44,407 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 14:10:44,409 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,409 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 14:10:44,409 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775844409"}]},"ts":"9223372036854775807"} 2023-07-19 14:10:44,409 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775844409"}]},"ts":"9223372036854775807"} 2023-07-19 14:10:44,411 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:10:44,411 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 40fa5fb7920e4b99b0e7dfda73f57c26, NAME => 'testtb-testExportWithTargetName,,1689775826971.40fa5fb7920e4b99b0e7dfda73f57c26.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 94144d20ed222489f4e84e6623888fba, NAME => 'testtb-testExportWithTargetName,1,1689775826971.94144d20ed222489f4e84e6623888fba.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:10:44,411 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 14:10:44,411 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775844411"}]},"ts":"9223372036854775807"} 2023-07-19 14:10:44,413 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 14:10:44,416 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 14:10:44,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 78 msec 2023-07-19 14:10:44,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 14:10:44,464 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 14:10:44,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 14:10:44,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 14:10:44,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 14:10:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 14:10:44,523 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 710) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:37086 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:46071 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:35177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:40444 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:55038 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1802576981_1 at /127.0.0.1:55024 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1802576981_1 at /127.0.0.1:37064 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3179 (was 4941) 2023-07-19 14:10:44,523 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 14:10:44,544 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=181, AvailableMemoryMB=3178 2023-07-19 14:10:44,544 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 14:10:44,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:10:44,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:10:44,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:10:44,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 14:10:44,551 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:10:44,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:44,554 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,554 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,555 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f empty. 2023-07-19 14:10:44,555 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 empty. 2023-07-19 14:10:44,555 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,555 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,555 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 14:10:44,573 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 14:10:44,574 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0cd1242b483b0d278ab4a51f94055c1f, NAME => 'testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:10:44,579 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f4c33293ac02eda45bb075f12e6b612, NAME => 'testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:10:44,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:44,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5f4c33293ac02eda45bb075f12e6b612, disabling compactions & flushes 2023-07-19 14:10:44,599 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. after waiting 0 ms 2023-07-19 14:10:44,599 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,599 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,600 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5f4c33293ac02eda45bb075f12e6b612: 2023-07-19 14:10:44,602 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:44,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0cd1242b483b0d278ab4a51f94055c1f, disabling compactions & flushes 2023-07-19 14:10:44,603 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. after waiting 0 ms 2023-07-19 14:10:44,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,603 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,603 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0cd1242b483b0d278ab4a51f94055c1f: 2023-07-19 14:10:44,606 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:10:44,607 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775844607"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775844607"}]},"ts":"1689775844607"} 2023-07-19 14:10:44,607 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775844607"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775844607"}]},"ts":"1689775844607"} 2023-07-19 14:10:44,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:10:44,611 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:10:44,611 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775844611"}]},"ts":"1689775844611"} 2023-07-19 14:10:44,613 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 14:10:44,617 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:10:44,618 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:10:44,618 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:10:44,618 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:10:44,618 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:10:44,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, ASSIGN}] 2023-07-19 14:10:44,621 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, ASSIGN 2023-07-19 14:10:44,621 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, ASSIGN 2023-07-19 14:10:44,622 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34059,1689775817131; forceNewPlan=false, retain=false 2023-07-19 14:10:44,623 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:10:44,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:44,773 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:10:44,775 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5f4c33293ac02eda45bb075f12e6b612, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:44,775 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0cd1242b483b0d278ab4a51f94055c1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:44,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775844775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775844775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775844775"}]},"ts":"1689775844775"} 2023-07-19 14:10:44,777 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775844775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775844775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775844775"}]},"ts":"1689775844775"} 2023-07-19 14:10:44,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 5f4c33293ac02eda45bb075f12e6b612, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:10:44,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 0cd1242b483b0d278ab4a51f94055c1f, server=jenkins-hbase4.apache.org,34059,1689775817131}] 2023-07-19 14:10:44,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:44,934 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:44,935 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:10:44,939 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:10:44,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f4c33293ac02eda45bb075f12e6b612, NAME => 'testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:10:44,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. service=AccessControlService 2023-07-19 14:10:44,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:44,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:44,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,946 INFO [StoreOpener-5f4c33293ac02eda45bb075f12e6b612-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cd1242b483b0d278ab4a51f94055c1f, NAME => 'testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:10:44,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. service=AccessControlService 2023-07-19 14:10:44,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:10:44,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:10:44,948 DEBUG [StoreOpener-5f4c33293ac02eda45bb075f12e6b612-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf 2023-07-19 14:10:44,948 DEBUG [StoreOpener-5f4c33293ac02eda45bb075f12e6b612-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf 2023-07-19 14:10:44,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,948 INFO [StoreOpener-5f4c33293ac02eda45bb075f12e6b612-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f4c33293ac02eda45bb075f12e6b612 columnFamilyName cf 2023-07-19 14:10:44,949 INFO [StoreOpener-5f4c33293ac02eda45bb075f12e6b612-1] regionserver.HStore(310): Store=5f4c33293ac02eda45bb075f12e6b612/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:44,949 INFO [StoreOpener-0cd1242b483b0d278ab4a51f94055c1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,952 DEBUG [StoreOpener-0cd1242b483b0d278ab4a51f94055c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf 2023-07-19 14:10:44,952 DEBUG [StoreOpener-0cd1242b483b0d278ab4a51f94055c1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf 2023-07-19 14:10:44,953 INFO [StoreOpener-0cd1242b483b0d278ab4a51f94055c1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cd1242b483b0d278ab4a51f94055c1f columnFamilyName cf 2023-07-19 14:10:44,953 INFO [StoreOpener-0cd1242b483b0d278ab4a51f94055c1f-1] regionserver.HStore(310): Store=0cd1242b483b0d278ab4a51f94055c1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:10:44,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:10:44,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:44,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f4c33293ac02eda45bb075f12e6b612; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67800871, jitterRate=0.010311707854270935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:44,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f4c33293ac02eda45bb075f12e6b612: 2023-07-19 14:10:44,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612., pid=30, masterSystemTime=1689775844934 2023-07-19 14:10:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:44,966 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5f4c33293ac02eda45bb075f12e6b612, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:44,967 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775844966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775844966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775844966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775844966"}]},"ts":"1689775844966"} 2023-07-19 14:10:44,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:10:44,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:10:44,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 14:10:44,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 5f4c33293ac02eda45bb075f12e6b612, server=jenkins-hbase4.apache.org,41889,1689775817007 in 190 msec 2023-07-19 14:10:44,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0cd1242b483b0d278ab4a51f94055c1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61178499, jitterRate=-0.08836932480335236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:10:44,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0cd1242b483b0d278ab4a51f94055c1f: 2023-07-19 14:10:44,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f., pid=31, masterSystemTime=1689775844934 2023-07-19 14:10:44,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, ASSIGN in 363 msec 2023-07-19 14:10:44,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:44,993 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0cd1242b483b0d278ab4a51f94055c1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:44,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775844993"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775844993"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775844993"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775844993"}]},"ts":"1689775844993"} 2023-07-19 14:10:45,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 14:10:45,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 0cd1242b483b0d278ab4a51f94055c1f, server=jenkins-hbase4.apache.org,34059,1689775817131 in 216 msec 2023-07-19 14:10:45,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-19 14:10:45,005 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:10:45,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, ASSIGN in 383 msec 2023-07-19 14:10:45,008 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775845008"}]},"ts":"1689775845008"} 2023-07-19 14:10:45,010 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 14:10:45,013 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:10:45,013 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 14:10:45,015 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:10:45,017 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,017 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,017 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,017 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:10:45,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:45,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:45,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:45,019 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:10:45,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 472 msec 2023-07-19 14:10:45,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 14:10:45,155 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 14:10:45,155 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 14:10:45,155 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:45,159 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 14:10:45,159 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:45,159 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-19 14:10:45,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:45,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775845162 (current time:1689775845162). 2023-07-19 14:10:45,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:45,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x4ab39ea9 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:45,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788839ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:45,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,175 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ab39ea9 to 127.0.0.1:58621 2023-07-19 14:10:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x45730369 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:45,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13638bb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:45,184 DEBUG [hconnection-0x2a1fbd1e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,187 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,192 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45730369 to 127.0.0.1:58621 2023-07-19 14:10:45,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:45,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:10:45,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:45,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:45,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:45,198 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:45,199 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776445199 2023-07-19 14:10:45,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 14:10:45,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:45,200 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:45,200 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:45,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:45,202 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:45,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 14:10:45,205 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:45,205 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776445205 2023-07-19 14:10:45,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,218 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 14:10:45,218 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,219 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 14:10:45,219 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:10:45,219 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,220 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,222 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,222 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,222 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,222 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,222 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,222 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,223 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,223 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:45,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:45,224 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:45,224 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,225 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:45,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,225 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:45,226 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:45,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,226 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,226 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:45,226 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:45,227 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:45,227 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:45,227 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:45,227 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,228 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:45,228 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:45,228 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:45,229 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,229 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,234 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,235 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,235 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:45,235 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,235 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:45,237 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35018e62[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:45,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35018e62[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:45,243 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:10:45,243 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:45,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,245 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:45,245 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:10:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:45,246 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:45,246 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,246 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:45,246 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. started... 2023-07-19 14:10:45,246 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:45,246 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. started... 2023-07-19 14:10:45,246 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,247 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0cd1242b483b0d278ab4a51f94055c1f: 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f4c33293ac02eda45bb075f12e6b612: 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:45,256 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:45,257 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:10:45,297 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. completed. 2023-07-19 14:10:45,297 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:45,297 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:45,297 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:45,297 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,297 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:45,297 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:10:45,299 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:45,300 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. completed. 2023-07-19 14:10:45,300 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:45,300 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:10:45,301 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:45,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:45,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:45,303 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,304 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:45,306 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34059,1689775817131': 2023-07-19 14:10:45,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:10:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:10:45,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:10:45,318 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 14:10:45,318 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:45,318 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:45,318 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,318 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:45,322 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,322 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,322 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,322 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,322 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,322 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,323 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,325 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,326 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,326 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,329 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,329 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,330 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,334 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,334 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,334 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,334 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,335 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,335 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,337 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,337 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,337 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,337 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,337 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 14:10:45,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,389 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 14:10:45,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689775845199Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689775845335 (+136 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689775845337 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689775845342 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689775845353 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689775845388 (+35 ms) 2023-07-19 14:10:45,391 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:45,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 191 msec 2023-07-19 14:10:45,503 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:45,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:45,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:45,515 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,520 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34059] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:45,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:10:45,526 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 14:10:45,527 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:45,528 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:10:45,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:45,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775845542 (current time:1689775845542). 2023-07-19 14:10:45,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:10:45,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x23abf93e to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:45,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d7ebe08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:45,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,558 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23abf93e to 127.0.0.1:58621 2023-07-19 14:10:45,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:45,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x791f9493 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:10:45,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d0790c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:10:45,673 DEBUG [hconnection-0x7092fece-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,675 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:10:45,690 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:10:45,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x791f9493 to 127.0.0.1:58621 2023-07-19 14:10:45,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:10:45,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:10:45,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:10:45,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:45,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:45,698 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:45,700 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776445700 2023-07-19 14:10:45,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:10:45,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 14:10:45,700 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:10:45,701 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:10:45,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:45,704 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:10:45,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-19 14:10:45,707 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:45,707 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776445707 2023-07-19 14:10:45,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 14:10:45,730 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 14:10:45,730 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,732 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 14:10:45,732 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:10:45,733 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,733 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,734 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,734 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,734 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,734 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,735 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,735 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,736 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,736 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 14:10:45,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 14:10:45,737 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:45,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 14:10:45,738 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,738 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:45,739 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:45,739 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:10:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 14:10:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 14:10:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 14:10:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,746 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,746 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,746 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,746 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,746 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,746 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,747 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:10:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8bd6cb[Count = 1] remaining members to acquire global barrier 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 14:10:45,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8bd6cb[Count = 0] remaining members to acquire global barrier 2023-07-19 14:10:45,751 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:10:45,751 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,752 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,752 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:45,752 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:45,753 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:45,753 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,753 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. started... 2023-07-19 14:10:45,753 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:10:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:10:45,753 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,754 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:10:45,754 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f4c33293ac02eda45bb075f12e6b612 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 14:10:45,753 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. started... 2023-07-19 14:10:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,754 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0cd1242b483b0d278ab4a51f94055c1f 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 14:10:45,754 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:10:45,754 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:45,754 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:10:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:45,788 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/.tmp/cf/389f85ff02c94e59b0d01063f61dd773 2023-07-19 14:10:45,792 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/.tmp/cf/d067b46662b3462c9c7c31e697e2839b 2023-07-19 14:10:45,800 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/.tmp/cf/389f85ff02c94e59b0d01063f61dd773 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf/389f85ff02c94e59b0d01063f61dd773 2023-07-19 14:10:45,802 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:45,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:45,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:10:45,805 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:10:45,807 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/.tmp/cf/d067b46662b3462c9c7c31e697e2839b as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf/d067b46662b3462c9c7c31e697e2839b 2023-07-19 14:10:45,810 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf/389f85ff02c94e59b0d01063f61dd773, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 14:10:45,811 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0cd1242b483b0d278ab4a51f94055c1f in 57ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:45,811 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 14:10:45,812 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0cd1242b483b0d278ab4a51f94055c1f: 2023-07-19 14:10:45,812 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:45,812 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:45,812 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf/389f85ff02c94e59b0d01063f61dd773] hfiles 2023-07-19 14:10:45,812 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf/389f85ff02c94e59b0d01063f61dd773 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:45,813 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf/d067b46662b3462c9c7c31e697e2839b, entries=47, sequenceid=6, filesize=8 K 2023-07-19 14:10:45,816 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5f4c33293ac02eda45bb075f12e6b612 in 63ms, sequenceid=6, compaction requested=false 2023-07-19 14:10:45,817 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f4c33293ac02eda45bb075f12e6b612: 2023-07-19 14:10:45,817 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:45,818 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:10:45,818 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf/d067b46662b3462c9c7c31e697e2839b] hfiles 2023-07-19 14:10:45,818 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf/d067b46662b3462c9c7c31e697e2839b for snapshot=snaptb0-testExportFileSystemState 2023-07-19 14:10:45,833 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. completed. 2023-07-19 14:10:45,834 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:10:45,834 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. completed. 2023-07-19 14:10:45,834 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:10:45,834 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,835 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 14:10:45,835 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:10:45,840 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:45,840 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,840 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,840 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:45,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,843 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 14:10:45,843 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,844 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 14:10:45,843 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34059,1689775817131': 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:10:45,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:10:45,852 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 14:10:45,852 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:10:45,852 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:10:45,852 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 14:10:45,852 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:10:45,854 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,854 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,855 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:10:45,856 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:10:45,858 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 14:10:45,858 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,859 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,862 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,862 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 14:10:45,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 14:10:45,862 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,862 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:10:45,862 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:10:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:10:45,862 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:10:45,862 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:10:45,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:10:45,863 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,865 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:10:45,865 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:10:45,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,865 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:10:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:10:45,865 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 14:10:45,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,937 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:45,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689775845700Consolidate snapshot: snaptb0-testExportFileSystemState at 1689775845863 (+163 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689775845863Writing data manifest for snaptb0-testExportFileSystemState at 1689775845870 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689775845887 (+17 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689775845936 (+49 ms) 2023-07-19 14:10:45,940 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 14:10:45,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 239 msec 2023-07-19 14:10:46,005 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:10:46,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:10:46,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:10:46,008 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008 2023-07-19 14:10:46,008 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35063, tgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008, rawTgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:46,034 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:10:46,034 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1338036740_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:46,034 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 14:10:46,051 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 14:10:46,489 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,490 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,490 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,491 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,491 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,492 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,492 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,571 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-7812920490865564263.jar 2023-07-19 14:10:46,572 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,572 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,573 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,573 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,574 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,574 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:10:46,574 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:10:46,575 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:10:46,575 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:10:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:10:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:10:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:10:46,577 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:10:46,577 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:10:46,578 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:10:46,578 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:10:46,579 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:46,579 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:46,580 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:46,580 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:46,580 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:10:46,581 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:46,581 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:10:47,100 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:10:47,102 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 14:10:47,105 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 14:10:49,045 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:49,045 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:10:49,051 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0001_000001 (auth:SIMPLE) 2023-07-19 14:10:49,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0002_000001 (auth:SIMPLE) 2023-07-19 14:10:49,810 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:10:54,087 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0002_000001 (auth:SIMPLE) 2023-07-19 14:10:56,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0002_000001 (auth:SIMPLE) 2023-07-19 14:10:59,249 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0002_000001 (auth:SIMPLE) 2023-07-19 14:11:00,316 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:00,317 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:00,325 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 14:11:00,326 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:00,326 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:00,326 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 14:11:00,327 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 14:11:00,327 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 14:11:00,327 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 14:11:00,327 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 14:11:00,327 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775846008/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 14:11:00,334 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 14:11:00,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 14:11:00,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 14:11:00,340 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775860340"}]},"ts":"1689775860340"} 2023-07-19 14:11:00,342 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 14:11:00,343 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 14:11:00,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, UNASSIGN}] 2023-07-19 14:11:00,346 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, UNASSIGN 2023-07-19 14:11:00,346 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, UNASSIGN 2023-07-19 14:11:00,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5f4c33293ac02eda45bb075f12e6b612, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:00,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0cd1242b483b0d278ab4a51f94055c1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:00,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775860347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775860347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775860347"}]},"ts":"1689775860347"} 2023-07-19 14:11:00,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775860347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775860347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775860347"}]},"ts":"1689775860347"} 2023-07-19 14:11:00,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 5f4c33293ac02eda45bb075f12e6b612, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:11:00,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 0cd1242b483b0d278ab4a51f94055c1f, server=jenkins-hbase4.apache.org,34059,1689775817131}] 2023-07-19 14:11:00,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 14:11:00,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:11:00,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f4c33293ac02eda45bb075f12e6b612, disabling compactions & flushes 2023-07-19 14:11:00,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:11:00,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:11:00,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. after waiting 0 ms 2023-07-19 14:11:00,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:11:00,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:11:00,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0cd1242b483b0d278ab4a51f94055c1f, disabling compactions & flushes 2023-07-19 14:11:00,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:11:00,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:11:00,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. after waiting 0 ms 2023-07-19 14:11:00,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:11:00,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:00,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:00,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:00,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:00,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612. 2023-07-19 14:11:00,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f4c33293ac02eda45bb075f12e6b612: 2023-07-19 14:11:00,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f. 2023-07-19 14:11:00,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0cd1242b483b0d278ab4a51f94055c1f: 2023-07-19 14:11:00,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:11:00,542 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5f4c33293ac02eda45bb075f12e6b612, regionState=CLOSED 2023-07-19 14:11:00,542 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775860542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775860542"}]},"ts":"1689775860542"} 2023-07-19 14:11:00,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:11:00,542 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=0cd1242b483b0d278ab4a51f94055c1f, regionState=CLOSED 2023-07-19 14:11:00,543 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689775860542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775860542"}]},"ts":"1689775860542"} 2023-07-19 14:11:00,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-19 14:11:00,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 5f4c33293ac02eda45bb075f12e6b612, server=jenkins-hbase4.apache.org,41889,1689775817007 in 194 msec 2023-07-19 14:11:00,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-19 14:11:00,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 0cd1242b483b0d278ab4a51f94055c1f, server=jenkins-hbase4.apache.org,34059,1689775817131 in 194 msec 2023-07-19 14:11:00,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5f4c33293ac02eda45bb075f12e6b612, UNASSIGN in 204 msec 2023-07-19 14:11:00,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-19 14:11:00,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0cd1242b483b0d278ab4a51f94055c1f, UNASSIGN in 204 msec 2023-07-19 14:11:00,551 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775860551"}]},"ts":"1689775860551"} 2023-07-19 14:11:00,552 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 14:11:00,554 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 14:11:00,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-19 14:11:00,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 14:11:00,642 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 14:11:00,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 14:11:00,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 14:11:00,648 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,649 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 14:11:00,653 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:11:00,653 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:11:00,655 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/recovered.edits] 2023-07-19 14:11:00,655 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/recovered.edits] 2023-07-19 14:11:00,658 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,658 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,658 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,658 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:00,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:00,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:00,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:00,663 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:00,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 14:11:00,665 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf/d067b46662b3462c9c7c31e697e2839b to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/cf/d067b46662b3462c9c7c31e697e2839b 2023-07-19 14:11:00,665 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf/389f85ff02c94e59b0d01063f61dd773 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/cf/389f85ff02c94e59b0d01063f61dd773 2023-07-19 14:11:00,669 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f/recovered.edits/9.seqid 2023-07-19 14:11:00,669 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612/recovered.edits/9.seqid 2023-07-19 14:11:00,670 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/0cd1242b483b0d278ab4a51f94055c1f 2023-07-19 14:11:00,670 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemState/5f4c33293ac02eda45bb075f12e6b612 2023-07-19 14:11:00,670 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 14:11:00,673 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,676 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 14:11:00,678 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 14:11:00,679 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,679 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 14:11:00,679 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775860679"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:00,680 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775860679"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:00,681 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:11:00,681 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0cd1242b483b0d278ab4a51f94055c1f, NAME => 'testtb-testExportFileSystemState,,1689775844545.0cd1242b483b0d278ab4a51f94055c1f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5f4c33293ac02eda45bb075f12e6b612, NAME => 'testtb-testExportFileSystemState,1,1689775844545.5f4c33293ac02eda45bb075f12e6b612.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:11:00,682 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 14:11:00,682 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775860682"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:00,683 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 14:11:00,686 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 14:11:00,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-19 14:11:00,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 14:11:00,766 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 14:11:00,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 14:11:00,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 14:11:00,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 14:11:00,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 14:11:00,806 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=770 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1256850280_1 at /127.0.0.1:48882 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:37664 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:45365 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1256850280_1 at /127.0.0.1:37140 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:42515 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:60626 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1758511710_17 at /127.0.0.1:60514 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=465 (was 371) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2974 (was 3178) 2023-07-19 14:11:00,807 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-19 14:11:00,826 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=770, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=465, ProcessCount=182, AvailableMemoryMB=2973 2023-07-19 14:11:00,826 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=770 is superior to 500 2023-07-19 14:11:00,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:11:00,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:00,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:00,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 14:11:00,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:00,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:00,835 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:00,835 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 2023-07-19 14:11:00,835 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 empty. 2023-07-19 14:11:00,835 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 empty. 2023-07-19 14:11:00,836 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:00,836 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 2023-07-19 14:11:00,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 14:11:00,849 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:00,850 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5ff16cd25cb1a275e974569bfa7c9533, NAME => 'testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:00,851 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0b044906937131735d1c10c75cff2426, NAME => 'testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:00,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:00,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 0b044906937131735d1c10c75cff2426, disabling compactions & flushes 2023-07-19 14:11:00,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:00,868 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:00,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 5ff16cd25cb1a275e974569bfa7c9533, disabling compactions & flushes 2023-07-19 14:11:00,868 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:00,869 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. after waiting 0 ms 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. after waiting 0 ms 2023-07-19 14:11:00,869 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 0b044906937131735d1c10c75cff2426: 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:00,869 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:00,869 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 5ff16cd25cb1a275e974569bfa7c9533: 2023-07-19 14:11:00,872 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:00,873 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775860873"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775860873"}]},"ts":"1689775860873"} 2023-07-19 14:11:00,873 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775860873"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775860873"}]},"ts":"1689775860873"} 2023-07-19 14:11:00,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:00,877 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:00,877 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775860877"}]},"ts":"1689775860877"} 2023-07-19 14:11:00,879 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 14:11:00,883 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:00,884 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:00,884 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:00,884 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:00,884 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:00,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, ASSIGN}] 2023-07-19 14:11:00,887 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, ASSIGN 2023-07-19 14:11:00,887 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, ASSIGN 2023-07-19 14:11:00,888 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:11:00,888 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34059,1689775817131; forceNewPlan=false, retain=false 2023-07-19 14:11:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:01,038 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:01,041 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5ff16cd25cb1a275e974569bfa7c9533, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,041 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0b044906937131735d1c10c75cff2426, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,041 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775861041"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775861041"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775861041"}]},"ts":"1689775861041"} 2023-07-19 14:11:01,041 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775861041"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775861041"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775861041"}]},"ts":"1689775861041"} 2023-07-19 14:11:01,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 0b044906937131735d1c10c75cff2426, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:11:01,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 5ff16cd25cb1a275e974569bfa7c9533, server=jenkins-hbase4.apache.org,34059,1689775817131}] 2023-07-19 14:11:01,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:01,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:01,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ff16cd25cb1a275e974569bfa7c9533, NAME => 'testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:11:01,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b044906937131735d1c10c75cff2426, NAME => 'testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. service=AccessControlService 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. service=AccessControlService 2023-07-19 14:11:01,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:01,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,203 INFO [StoreOpener-0b044906937131735d1c10c75cff2426-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,203 INFO [StoreOpener-5ff16cd25cb1a275e974569bfa7c9533-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,204 DEBUG [StoreOpener-0b044906937131735d1c10c75cff2426-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf 2023-07-19 14:11:01,204 DEBUG [StoreOpener-5ff16cd25cb1a275e974569bfa7c9533-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf 2023-07-19 14:11:01,204 DEBUG [StoreOpener-5ff16cd25cb1a275e974569bfa7c9533-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf 2023-07-19 14:11:01,204 DEBUG [StoreOpener-0b044906937131735d1c10c75cff2426-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf 2023-07-19 14:11:01,205 INFO [StoreOpener-5ff16cd25cb1a275e974569bfa7c9533-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ff16cd25cb1a275e974569bfa7c9533 columnFamilyName cf 2023-07-19 14:11:01,205 INFO [StoreOpener-0b044906937131735d1c10c75cff2426-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b044906937131735d1c10c75cff2426 columnFamilyName cf 2023-07-19 14:11:01,205 INFO [StoreOpener-5ff16cd25cb1a275e974569bfa7c9533-1] regionserver.HStore(310): Store=5ff16cd25cb1a275e974569bfa7c9533/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:01,205 INFO [StoreOpener-0b044906937131735d1c10c75cff2426-1] regionserver.HStore(310): Store=0b044906937131735d1c10c75cff2426/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:01,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:01,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:01,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:01,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5ff16cd25cb1a275e974569bfa7c9533; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73177109, jitterRate=0.09042389690876007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:01,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5ff16cd25cb1a275e974569bfa7c9533: 2023-07-19 14:11:01,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b044906937131735d1c10c75cff2426; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63829028, jitterRate=-0.04887336492538452}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:01,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b044906937131735d1c10c75cff2426: 2023-07-19 14:11:01,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533., pid=46, masterSystemTime=1689775861195 2023-07-19 14:11:01,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426., pid=45, masterSystemTime=1689775861195 2023-07-19 14:11:01,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,217 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=5ff16cd25cb1a275e974569bfa7c9533, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:01,217 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775861217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775861217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775861217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775861217"}]},"ts":"1689775861217"} 2023-07-19 14:11:01,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:01,218 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0b044906937131735d1c10c75cff2426, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,218 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775861218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775861218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775861218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775861218"}]},"ts":"1689775861218"} 2023-07-19 14:11:01,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-19 14:11:01,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 5ff16cd25cb1a275e974569bfa7c9533, server=jenkins-hbase4.apache.org,34059,1689775817131 in 175 msec 2023-07-19 14:11:01,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-19 14:11:01,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 0b044906937131735d1c10c75cff2426, server=jenkins-hbase4.apache.org,41889,1689775817007 in 177 msec 2023-07-19 14:11:01,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, ASSIGN in 338 msec 2023-07-19 14:11:01,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 14:11:01,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, ASSIGN in 339 msec 2023-07-19 14:11:01,225 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:01,225 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775861225"}]},"ts":"1689775861225"} 2023-07-19 14:11:01,227 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 14:11:01,229 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:01,230 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 14:11:01,232 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 14:11:01,233 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,233 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,233 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,233 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:01,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:01,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:01,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:01,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:01,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 406 msec 2023-07-19 14:11:01,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 14:11:01,436 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 14:11:01,436 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-19 14:11:01,436 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:01,439 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-19 14:11:01,440 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:01,440 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-19 14:11:01,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:01,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775861443 (current time:1689775861443). 2023-07-19 14:11:01,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:01,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x08501e6c to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:01,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5626d449, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:01,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:01,454 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:01,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08501e6c to 127.0.0.1:58621 2023-07-19 14:11:01,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:01,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x5898deb0 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:01,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@503308b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:01,463 DEBUG [hconnection-0x30571a62-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:01,466 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:01,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:01,472 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:01,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5898deb0 to 127.0.0.1:58621 2023-07-19 14:11:01,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:01,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 14:11:01,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:01,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:01,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:01,477 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:01,478 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689776461478 2023-07-19 14:11:01,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:01,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 14:11:01,479 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:01,479 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:01,480 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:01,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:01,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-19 14:11:01,483 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:01,483 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689776461483 2023-07-19 14:11:01,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,497 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 14:11:01,498 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,499 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 14:11:01,499 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 14:11:01,500 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,500 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,502 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,502 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,502 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,502 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,502 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,502 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,502 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,502 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 14:11:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:01,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,504 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:01,504 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:01,504 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,504 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,505 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:01,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:01,507 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,510 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:01,510 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:01,510 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:01,512 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,512 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,513 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25a74da3[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25a74da3[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:01,517 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 14:11:01,518 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:01,519 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,519 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:01,519 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:01,520 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:01,520 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. started... 2023-07-19 14:11:01,522 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:01,522 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:01,522 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,522 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b044906937131735d1c10c75cff2426: 2023-07-19 14:11:01,522 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. started... 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ff16cd25cb1a275e974569bfa7c9533: 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:01,523 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:01,536 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. completed. 2023-07-19 14:11:01,536 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,536 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. completed. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:01,536 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:01,536 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:01,538 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,538 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:01,538 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,538 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:01,538 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:01,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,538 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:01,538 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:01,540 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34059,1689775817131': 2023-07-19 14:11:01,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 14:11:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:11:01,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 14:11:01,551 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 14:11:01,551 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:01,552 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:01,552 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,552 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:01,553 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,553 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,553 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,553 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:01,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,553 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:01,553 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:01,554 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:01,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:01,555 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:01,556 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,561 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,561 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,562 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,565 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:01,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:01,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,567 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,567 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,567 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,567 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:01,565 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:01,567 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:01,567 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:01,579 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:01,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:01,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:01,581 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:01,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 14:11:01,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,607 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:01,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689775861478Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689775861567 (+89 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689775861567Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689775861571 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689775861580 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689775861607 (+27 ms) 2023-07-19 14:11:01,610 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:01,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 131 msec 2023-07-19 14:11:01,781 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:01,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:01,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:01,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34059] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:01,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:01,796 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 14:11:01,796 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,796 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:01,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:01,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775861808 (current time:1689775861808). 2023-07-19 14:11:01,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:01,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x6154e724 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:01,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5206249d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:01,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:01,824 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:01,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6154e724 to 127.0.0.1:58621 2023-07-19 14:11:01,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:01,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x3e48aa6b to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78e31741, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:01,833 DEBUG [hconnection-0x1b22f60c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:01,836 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:01,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:01,842 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:01,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e48aa6b to 127.0.0.1:58621 2023-07-19 14:11:01,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:01,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 14:11:01,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:01,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:01,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:01,854 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:01,855 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689776461855 2023-07-19 14:11:01,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 14:11:01,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 14:11:01,857 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:01,858 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:01,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:01,858 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 14:11:01,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-19 14:11:01,861 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:01,862 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689776461862 2023-07-19 14:11:01,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 14:11:01,903 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 14:11:01,903 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,905 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 14:11:01,905 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 14:11:01,907 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 14:11:01,946 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,946 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,949 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:01,949 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,949 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,950 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,950 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,950 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:01,951 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:01,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 14:11:01,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 14:11:01,951 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:01,951 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:01,951 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 14:11:01,953 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:01,953 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:01,951 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,953 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:01,954 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:01,954 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,954 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:01,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 14:11:01,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 14:11:01,955 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 14:11:01,955 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 14:11:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 14:11:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 14:11:01,956 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,956 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,957 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,957 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:01,958 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,958 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:01,958 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:01,958 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:01,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,959 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ed49078[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:01,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 14:11:01,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ed49078[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:01,962 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 14:11:01,962 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,962 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:01,965 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:01,966 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:01,966 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:01,966 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:01,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 14:11:01,966 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:01,966 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. started... 2023-07-19 14:11:01,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:01,966 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:01,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:01,966 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b044906937131735d1c10c75cff2426 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 14:11:01,966 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. started... 2023-07-19 14:11:01,966 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5ff16cd25cb1a275e974569bfa7c9533 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 14:11:01,967 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:01,967 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:01,967 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:02,007 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/.tmp/cf/f39ad8899304493789f0e3998adbb2d8 2023-07-19 14:11:02,007 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/.tmp/cf/c26cce900e1141d797d5d96241c9adb7 2023-07-19 14:11:02,015 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/.tmp/cf/c26cce900e1141d797d5d96241c9adb7 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf/c26cce900e1141d797d5d96241c9adb7 2023-07-19 14:11:02,016 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/.tmp/cf/f39ad8899304493789f0e3998adbb2d8 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf/f39ad8899304493789f0e3998adbb2d8 2023-07-19 14:11:02,023 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf/c26cce900e1141d797d5d96241c9adb7, entries=48, sequenceid=6, filesize=8.1 K 2023-07-19 14:11:02,025 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0b044906937131735d1c10c75cff2426 in 59ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:02,026 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b044906937131735d1c10c75cff2426: 2023-07-19 14:11:02,027 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:02,027 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:02,027 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf/c26cce900e1141d797d5d96241c9adb7] hfiles 2023-07-19 14:11:02,027 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf/c26cce900e1141d797d5d96241c9adb7 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:02,028 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf/f39ad8899304493789f0e3998adbb2d8, entries=2, sequenceid=6, filesize=5.0 K 2023-07-19 14:11:02,029 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 5ff16cd25cb1a275e974569bfa7c9533 in 63ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:02,030 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5ff16cd25cb1a275e974569bfa7c9533: 2023-07-19 14:11:02,030 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:02,030 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:02,030 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf/f39ad8899304493789f0e3998adbb2d8] hfiles 2023-07-19 14:11:02,030 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf/f39ad8899304493789f0e3998adbb2d8 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 14:11:02,072 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. completed. 2023-07-19 14:11:02,072 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:02,075 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. completed. 2023-07-19 14:11:02,075 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:02,075 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:02,075 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:02,075 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,075 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 14:11:02,075 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:02,076 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,077 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,077 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,077 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 14:11:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 14:11:02,079 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:11:02,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 14:11:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34059,1689775817131': 2023-07-19 14:11:02,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 14:11:02,092 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 14:11:02,092 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:02,092 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:02,092 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 14:11:02,092 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:02,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:02,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,096 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,097 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:02,098 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,099 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,102 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:02,103 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 14:11:02,103 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,112 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,112 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,112 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,113 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 14:11:02,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,112 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:02,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 14:11:02,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,113 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,113 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:02,113 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:02,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,113 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:02,113 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:02,115 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,116 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:02,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:02,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,160 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:02,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:02,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:02,161 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:02,195 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 14:11:02,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,195 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689775861856Consolidate snapshot: snaptb0-testConsecutiveExports at 1689775862113 (+257 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689775862113Writing data manifest for snaptb0-testConsecutiveExports at 1689775862127 (+14 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689775862143 (+16 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689775862195 (+52 ms) 2023-07-19 14:11:02,202 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 14:11:02,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 345 msec 2023-07-19 14:11:02,461 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:02,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 14:11:02,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:02,463 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463 2023-07-19 14:11:02,463 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:02,488 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:02,488 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@66dc11bb, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,488 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 14:11:02,497 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:02,509 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,510 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,510 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,510 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,511 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,511 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,511 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,586 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-3258299823328868285.jar 2023-07-19 14:11:02,586 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,587 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,588 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,588 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,589 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,589 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:02,590 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:02,590 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:02,591 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:02,592 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:02,592 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:02,593 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:02,594 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:02,594 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:02,594 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:02,595 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:02,596 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:02,596 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:02,596 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:02,597 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:02,597 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:02,597 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:02,598 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:03,579 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:03,582 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 14:11:03,584 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 14:11:05,420 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:05,421 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:05,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0002_000001 (auth:SIMPLE) 2023-07-19 14:11:06,057 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:06,116 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:11:10,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:12,568 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:15,780 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:17,817 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:17,817 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:17,821 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 14:11:17,821 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:17,822 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:17,822 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@b772a30 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:17,826 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:17,848 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:17,849 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7de2c247, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:17,849 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 14:11:17,859 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 14:11:17,871 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,871 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,871 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,872 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,872 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,873 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,873 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,940 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-4010042647848571517.jar 2023-07-19 14:11:17,941 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,941 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,942 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,942 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,943 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,943 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:17,944 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:17,944 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:17,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:17,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:17,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:17,946 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:17,946 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:17,947 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:17,947 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:17,947 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:17,948 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:17,948 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:17,948 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:17,949 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:17,949 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:17,949 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:17,950 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:18,338 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:18,340 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 14:11:18,342 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 14:11:21,956 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:21,956 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:21,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0003_000001 (auth:SIMPLE) 2023-07-19 14:11:22,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:26,974 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:29,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:32,040 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:33,543 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:33,543 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:33,551 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 14:11:33,551 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:33,551 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:33,552 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:33,558 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:33,558 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:33,558 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@b772a30 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 14:11:33,558 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 14:11:33,558 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/local-export-1689775862463/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 14:11:33,570 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 14:11:33,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 14:11:33,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 14:11:33,576 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775893576"}]},"ts":"1689775893576"} 2023-07-19 14:11:33,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 14:11:33,581 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 14:11:33,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, UNASSIGN}] 2023-07-19 14:11:33,583 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, UNASSIGN 2023-07-19 14:11:33,585 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, UNASSIGN 2023-07-19 14:11:33,586 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0b044906937131735d1c10c75cff2426, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:33,586 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775893586"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775893586"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775893586"}]},"ts":"1689775893586"} 2023-07-19 14:11:33,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=5ff16cd25cb1a275e974569bfa7c9533, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:33,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775893613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775893613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775893613"}]},"ts":"1689775893613"} 2023-07-19 14:11:33,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 0b044906937131735d1c10c75cff2426, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:11:33,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 5ff16cd25cb1a275e974569bfa7c9533, server=jenkins-hbase4.apache.org,34059,1689775817131}] 2023-07-19 14:11:33,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 14:11:33,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:33,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b044906937131735d1c10c75cff2426, disabling compactions & flushes 2023-07-19 14:11:33,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:33,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:33,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. after waiting 0 ms 2023-07-19 14:11:33,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:33,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5ff16cd25cb1a275e974569bfa7c9533, disabling compactions & flushes 2023-07-19 14:11:33,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. after waiting 0 ms 2023-07-19 14:11:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:33,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:33,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:33,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426. 2023-07-19 14:11:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b044906937131735d1c10c75cff2426: 2023-07-19 14:11:33,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b044906937131735d1c10c75cff2426 2023-07-19 14:11:33,808 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0b044906937131735d1c10c75cff2426, regionState=CLOSED 2023-07-19 14:11:33,808 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775893808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775893808"}]},"ts":"1689775893808"} 2023-07-19 14:11:33,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:33,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:33,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533. 2023-07-19 14:11:33,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5ff16cd25cb1a275e974569bfa7c9533: 2023-07-19 14:11:33,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 14:11:33,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 0b044906937131735d1c10c75cff2426, server=jenkins-hbase4.apache.org,41889,1689775817007 in 203 msec 2023-07-19 14:11:33,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:33,823 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=5ff16cd25cb1a275e974569bfa7c9533, regionState=CLOSED 2023-07-19 14:11:33,824 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689775893823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775893823"}]},"ts":"1689775893823"} 2023-07-19 14:11:33,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0b044906937131735d1c10c75cff2426, UNASSIGN in 239 msec 2023-07-19 14:11:33,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 14:11:33,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 5ff16cd25cb1a275e974569bfa7c9533, server=jenkins-hbase4.apache.org,34059,1689775817131 in 209 msec 2023-07-19 14:11:33,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-19 14:11:33,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5ff16cd25cb1a275e974569bfa7c9533, UNASSIGN in 245 msec 2023-07-19 14:11:33,829 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775893829"}]},"ts":"1689775893829"} 2023-07-19 14:11:33,830 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 14:11:33,832 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 14:11:33,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 262 msec 2023-07-19 14:11:33,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 14:11:33,878 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 14:11:33,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 14:11:33,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,883 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 14:11:33,885 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,886 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 14:11:33,890 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,890 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,890 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,890 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:33,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:33,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:33,891 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 14:11:33,892 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:33,892 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:33,894 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:33,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 14:11:33,896 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/recovered.edits] 2023-07-19 14:11:33,896 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/recovered.edits] 2023-07-19 14:11:33,900 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf/f39ad8899304493789f0e3998adbb2d8 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/cf/f39ad8899304493789f0e3998adbb2d8 2023-07-19 14:11:33,901 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf/c26cce900e1141d797d5d96241c9adb7 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/cf/c26cce900e1141d797d5d96241c9adb7 2023-07-19 14:11:33,904 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533/recovered.edits/9.seqid 2023-07-19 14:11:33,905 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426/recovered.edits/9.seqid 2023-07-19 14:11:33,905 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/5ff16cd25cb1a275e974569bfa7c9533 2023-07-19 14:11:33,906 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testConsecutiveExports/0b044906937131735d1c10c75cff2426 2023-07-19 14:11:33,906 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 14:11:33,909 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,916 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 14:11:33,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 14:11:33,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 14:11:33,920 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775893920"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:33,920 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775893920"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:33,924 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:11:33,924 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5ff16cd25cb1a275e974569bfa7c9533, NAME => 'testtb-testConsecutiveExports,,1689775860827.5ff16cd25cb1a275e974569bfa7c9533.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0b044906937131735d1c10c75cff2426, NAME => 'testtb-testConsecutiveExports,1,1689775860827.0b044906937131735d1c10c75cff2426.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:11:33,924 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 14:11:33,924 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775893924"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:33,928 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 14:11:33,931 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 14:11:33,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 52 msec 2023-07-19 14:11:33,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 14:11:33,998 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 14:11:34,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 14:11:34,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 14:11:34,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 14:11:34,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 14:11:34,044 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 770), OpenFileDescriptor=897 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=412 (was 465), ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=3261 (was 2973) - AvailableMemoryMB LEAK? - 2023-07-19 14:11:34,044 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-19 14:11:34,073 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=412, ProcessCount=184, AvailableMemoryMB=3256 2023-07-19 14:11:34,073 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-19 14:11:34,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:11:34,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,080 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:34,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 14:11:34,081 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:34,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:34,090 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,090 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,091 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 empty. 2023-07-19 14:11:34,091 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b empty. 2023-07-19 14:11:34,091 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,091 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,091 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 14:11:34,116 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:34,117 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c7b3f44da65ff04ede45adb1a0aeaf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:34,119 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 80b004c9c9a80fcb0cad6c84c79af13b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:34,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:34,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9c7b3f44da65ff04ede45adb1a0aeaf4, disabling compactions & flushes 2023-07-19 14:11:34,143 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. after waiting 0 ms 2023-07-19 14:11:34,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,143 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,143 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9c7b3f44da65ff04ede45adb1a0aeaf4: 2023-07-19 14:11:34,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:34,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 80b004c9c9a80fcb0cad6c84c79af13b, disabling compactions & flushes 2023-07-19 14:11:34,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. after waiting 0 ms 2023-07-19 14:11:34,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 80b004c9c9a80fcb0cad6c84c79af13b: 2023-07-19 14:11:34,160 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:34,162 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775894161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775894161"}]},"ts":"1689775894161"} 2023-07-19 14:11:34,162 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775894161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775894161"}]},"ts":"1689775894161"} 2023-07-19 14:11:34,171 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:34,172 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:34,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775894172"}]},"ts":"1689775894172"} 2023-07-19 14:11:34,173 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 14:11:34,176 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:34,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:34,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:34,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:34,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:34,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, ASSIGN}] 2023-07-19 14:11:34,181 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, ASSIGN 2023-07-19 14:11:34,181 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, ASSIGN 2023-07-19 14:11:34,182 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:11:34,182 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34059,1689775817131; forceNewPlan=false, retain=false 2023-07-19 14:11:34,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:34,332 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:34,335 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=80b004c9c9a80fcb0cad6c84c79af13b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775894335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775894335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775894335"}]},"ts":"1689775894335"} 2023-07-19 14:11:34,336 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9c7b3f44da65ff04ede45adb1a0aeaf4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,336 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775894336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775894336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775894336"}]},"ts":"1689775894336"} 2023-07-19 14:11:34,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 80b004c9c9a80fcb0cad6c84c79af13b, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:34,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 9c7b3f44da65ff04ede45adb1a0aeaf4, server=jenkins-hbase4.apache.org,34059,1689775817131}] 2023-07-19 14:11:34,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:34,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80b004c9c9a80fcb0cad6c84c79af13b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:11:34,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. service=AccessControlService 2023-07-19 14:11:34,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:34,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:34,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c7b3f44da65ff04ede45adb1a0aeaf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:11:34,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. service=AccessControlService 2023-07-19 14:11:34,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:34,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:34,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,509 INFO [StoreOpener-80b004c9c9a80fcb0cad6c84c79af13b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,515 INFO [StoreOpener-9c7b3f44da65ff04ede45adb1a0aeaf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,519 DEBUG [StoreOpener-9c7b3f44da65ff04ede45adb1a0aeaf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf 2023-07-19 14:11:34,519 DEBUG [StoreOpener-9c7b3f44da65ff04ede45adb1a0aeaf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf 2023-07-19 14:11:34,521 INFO [StoreOpener-9c7b3f44da65ff04ede45adb1a0aeaf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c7b3f44da65ff04ede45adb1a0aeaf4 columnFamilyName cf 2023-07-19 14:11:34,522 INFO [StoreOpener-9c7b3f44da65ff04ede45adb1a0aeaf4-1] regionserver.HStore(310): Store=9c7b3f44da65ff04ede45adb1a0aeaf4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:34,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:34,530 DEBUG [StoreOpener-80b004c9c9a80fcb0cad6c84c79af13b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf 2023-07-19 14:11:34,530 DEBUG [StoreOpener-80b004c9c9a80fcb0cad6c84c79af13b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf 2023-07-19 14:11:34,531 INFO [StoreOpener-80b004c9c9a80fcb0cad6c84c79af13b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80b004c9c9a80fcb0cad6c84c79af13b columnFamilyName cf 2023-07-19 14:11:34,532 INFO [StoreOpener-80b004c9c9a80fcb0cad6c84c79af13b-1] regionserver.HStore(310): Store=80b004c9c9a80fcb0cad6c84c79af13b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:34,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:34,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c7b3f44da65ff04ede45adb1a0aeaf4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68480883, jitterRate=0.020444676280021667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:34,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c7b3f44da65ff04ede45adb1a0aeaf4: 2023-07-19 14:11:34,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4., pid=61, masterSystemTime=1689775894502 2023-07-19 14:11:34,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,546 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9c7b3f44da65ff04ede45adb1a0aeaf4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,546 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775894546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775894546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775894546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775894546"}]},"ts":"1689775894546"} 2023-07-19 14:11:34,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:34,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-19 14:11:34,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 9c7b3f44da65ff04ede45adb1a0aeaf4, server=jenkins-hbase4.apache.org,34059,1689775817131 in 216 msec 2023-07-19 14:11:34,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, ASSIGN in 382 msec 2023-07-19 14:11:34,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:34,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80b004c9c9a80fcb0cad6c84c79af13b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68620375, jitterRate=0.022523269057273865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:34,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80b004c9c9a80fcb0cad6c84c79af13b: 2023-07-19 14:11:34,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b., pid=60, masterSystemTime=1689775894494 2023-07-19 14:11:34,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,579 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=80b004c9c9a80fcb0cad6c84c79af13b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,580 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775894579"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775894579"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775894579"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775894579"}]},"ts":"1689775894579"} 2023-07-19 14:11:34,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-19 14:11:34,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 80b004c9c9a80fcb0cad6c84c79af13b, server=jenkins-hbase4.apache.org,36051,1689775817079 in 242 msec 2023-07-19 14:11:34,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-19 14:11:34,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, ASSIGN in 406 msec 2023-07-19 14:11:34,588 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:34,588 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775894588"}]},"ts":"1689775894588"} 2023-07-19 14:11:34,590 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 14:11:34,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:34,601 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 14:11:34,611 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 14:11:34,613 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:34,613 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:34,613 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:34,613 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:34,615 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:34,615 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:34,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 539 msec 2023-07-19 14:11:34,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:34,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:34,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 14:11:34,686 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 14:11:34,686 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-19 14:11:34,686 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:34,690 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-19 14:11:34,690 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:34,690 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-19 14:11:34,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:34,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775894693 (current time:1689775894693). 2023-07-19 14:11:34,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:34,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x5080afcf to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:34,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67e33ff3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:34,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:34,703 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:34,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5080afcf to 127.0.0.1:58621 2023-07-19 14:11:34,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:34,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x0788a6e9 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:34,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52239f00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:34,719 DEBUG [hconnection-0x2cc13e10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:34,720 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:34,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:34,726 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:34,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0788a6e9 to 127.0.0.1:58621 2023-07-19 14:11:34,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:34,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 14:11:34,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:34,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:34,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:34,732 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:34,732 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689776494732 2023-07-19 14:11:34,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:34,734 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:34,734 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:34,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:34,736 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:34,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 14:11:34,738 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:34,739 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689776494739 2023-07-19 14:11:34,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,754 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:34,755 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:34,757 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 14:11:34,758 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 14:11:34,758 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,758 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,760 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:34,760 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:34,760 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:34,760 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:34,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:34,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:34,760 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:34,760 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,761 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,761 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,762 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:34,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:34,763 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:34,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:34,767 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:34,769 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:34,773 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,773 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,773 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,773 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,774 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f7b5e[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:34,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:34,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f7b5e[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:34,778 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 14:11:34,779 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,780 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,780 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:34,780 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,780 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:34,780 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:34,780 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,780 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,781 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:34,781 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. started... 2023-07-19 14:11:34,782 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c7b3f44da65ff04ede45adb1a0aeaf4: 2023-07-19 14:11:34,782 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,782 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:34,782 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:34,782 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,783 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,783 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:34,783 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:34,783 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:34,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,783 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:34,783 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:34,783 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:34,783 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,783 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. started... 2023-07-19 14:11:34,785 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80b004c9c9a80fcb0cad6c84c79af13b: 2023-07-19 14:11:34,785 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,785 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:34,785 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:34,794 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:34,794 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:34,794 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:34,800 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. completed. 2023-07-19 14:11:34,801 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:34,801 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. completed. 2023-07-19 14:11:34,801 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:34,803 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:34,803 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:34,804 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:34,805 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:34,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:34,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34059,1689775817131': 2023-07-19 14:11:34,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 14:11:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:34,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:34,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:11:34,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 14:11:34,817 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 14:11:34,817 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:34,817 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:34,817 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,817 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:34,820 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:34,820 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:34,820 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,820 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:34,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,821 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:34,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:34,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:34,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:34,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,823 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:34,824 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,824 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:34,827 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,827 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,828 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:34,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:34,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:34,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:34,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:34,832 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,833 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,833 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:34,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:34,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,832 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:34,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:34,835 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:34,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:34,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:34,833 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,835 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:34,835 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:34,835 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,835 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:34,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:34,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:34,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:34,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:34,836 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:34,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 14:11:34,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,946 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:34,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689775894732Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775894833 (+101 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775894835 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775894839 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689775894860 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689775894945 (+85 ms) 2023-07-19 14:11:34,949 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:34,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 215 msec 2023-07-19 14:11:35,037 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:35,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:35,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:35,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36051] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:35,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34059] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:35,074 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,075 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:35,075 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:35,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:35,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775895091 (current time:1689775895091). 2023-07-19 14:11:35,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:35,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x18b1dfee to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:35,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43f68299, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:35,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:35,110 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18b1dfee to 127.0.0.1:58621 2023-07-19 14:11:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:35,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x27505c17 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:35,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3188b9bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:35,127 DEBUG [hconnection-0x469d075e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:35,131 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:35,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:35,139 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:35,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27505c17 to 127.0.0.1:58621 2023-07-19 14:11:35,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:35,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 14:11:35,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:35,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:35,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:35,149 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:35,150 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689776495150 2023-07-19 14:11:35,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 14:11:35,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,155 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:35,155 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:35,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:35,160 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 14:11:35,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-19 14:11:35,163 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:35,164 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689776495164 2023-07-19 14:11:35,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,182 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:35,182 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:35,184 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 14:11:35,184 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 14:11:35,184 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,184 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,186 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:35,186 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:35,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:35,186 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:35,186 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:35,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:35,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:35,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,187 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,188 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,189 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,189 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:35,190 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 14:11:35,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,190 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:35,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,190 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:35,190 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:35,190 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:35,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 14:11:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 14:11:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 14:11:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 14:11:35,197 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,198 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,198 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:35,198 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:35,199 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,199 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:35,199 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,199 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:35,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:35,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:35,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:35,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e1c8e8[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:35,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 14:11:35,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e1c8e8[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:35,207 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 14:11:35,207 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,209 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,209 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,209 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,210 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,210 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:35,210 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 14:11:35,210 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,210 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:35,210 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:35,211 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:35,211 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:35,211 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:35,211 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. started... 2023-07-19 14:11:35,211 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,211 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:35,212 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 80b004c9c9a80fcb0cad6c84c79af13b 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-19 14:11:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:35,212 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:35,214 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:35,215 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:35,216 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:35,217 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. started... 2023-07-19 14:11:35,217 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c7b3f44da65ff04ede45adb1a0aeaf4 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-19 14:11:35,255 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:35,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:35,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:35,257 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:35,310 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/.tmp/cf/edf5527606b54661b43bfe4214147834 2023-07-19 14:11:35,311 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/.tmp/cf/57010d39f8bf4600aa0267bcb6e85865 2023-07-19 14:11:35,320 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/.tmp/cf/57010d39f8bf4600aa0267bcb6e85865 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf/57010d39f8bf4600aa0267bcb6e85865 2023-07-19 14:11:35,321 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/.tmp/cf/edf5527606b54661b43bfe4214147834 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf/edf5527606b54661b43bfe4214147834 2023-07-19 14:11:35,327 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf/edf5527606b54661b43bfe4214147834, entries=7, sequenceid=6, filesize=5.3 K 2023-07-19 14:11:35,328 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf/57010d39f8bf4600aa0267bcb6e85865, entries=43, sequenceid=6, filesize=7.7 K 2023-07-19 14:11:35,329 INFO [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 9c7b3f44da65ff04ede45adb1a0aeaf4 in 112ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:35,329 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:35,329 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 80b004c9c9a80fcb0cad6c84c79af13b in 118ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:35,330 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 14:11:35,330 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c7b3f44da65ff04ede45adb1a0aeaf4: 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf/edf5527606b54661b43bfe4214147834] hfiles 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf/edf5527606b54661b43bfe4214147834 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80b004c9c9a80fcb0cad6c84c79af13b: 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,332 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:35,333 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf/57010d39f8bf4600aa0267bcb6e85865] hfiles 2023-07-19 14:11:35,333 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf/57010d39f8bf4600aa0267bcb6e85865 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,359 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. completed. 2023-07-19 14:11:35,359 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:35,359 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:35,359 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:35,360 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,360 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:35,360 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:35,361 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,361 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:35,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:35,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:35,362 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:35,362 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:35,362 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. completed. 2023-07-19 14:11:35,364 DEBUG [rs(jenkins-hbase4.apache.org,34059,1689775817131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:35,364 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:35,364 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:35,364 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,364 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 14:11:35,364 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:35,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:35,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:35,366 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 14:11:35,366 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:35,366 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,366 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 14:11:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:11:35,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 14:11:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:35,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34059,1689775817131': 2023-07-19 14:11:35,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 14:11:35,375 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 14:11:35,375 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:35,375 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:35,375 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,375 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:35,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:35,382 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:35,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,383 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:35,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:35,387 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,387 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,388 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,390 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:35,390 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,391 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:35,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:35,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:35,401 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:35,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:35,401 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:35,403 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,403 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,403 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,403 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,403 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,404 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,404 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:35,404 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:35,404 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,404 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:35,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:35,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:35,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:35,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:35,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:35,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-19 14:11:35,457 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:35,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:35,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:35,459 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:35,759 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:35,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:35,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:35,761 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 14:11:35,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 14:11:35,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,959 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:35,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689775895150Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689775895403 (+253 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689775895404 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689775895411 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689775895848 (+437 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689775895958 (+110 ms) 2023-07-19 14:11:35,962 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 14:11:35,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 811 msec 2023-07-19 14:11:36,261 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:36,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 14:11:36,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:36,301 DEBUG [Listener at jenkins-hbase4.apache.org/45907] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:11:36,306 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:11:36,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34059] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 14:11:36,308 DEBUG [Listener at jenkins-hbase4.apache.org/45907] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:11:36,312 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:11:36,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36051] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 14:11:36,313 DEBUG [Listener at jenkins-hbase4.apache.org/45907] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 14:11:36,317 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 14:11:36,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 14:11:36,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:11:36,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:36,329 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:36,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 14:11:36,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:36,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:36,343 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,350 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,350 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 empty. 2023-07-19 14:11:36,351 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f empty. 2023-07-19 14:11:36,352 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,352 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 14:11:36,393 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:36,394 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c689e3facd51ed38b9029954e99dd66, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:36,395 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 39a74205fe967b606012a20b09316e8f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:36,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:36,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 7c689e3facd51ed38b9029954e99dd66, disabling compactions & flushes 2023-07-19 14:11:36,432 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. after waiting 0 ms 2023-07-19 14:11:36,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,432 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 7c689e3facd51ed38b9029954e99dd66: 2023-07-19 14:11:36,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:36,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:36,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 39a74205fe967b606012a20b09316e8f, disabling compactions & flushes 2023-07-19 14:11:36,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. after waiting 0 ms 2023-07-19 14:11:36,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 39a74205fe967b606012a20b09316e8f: 2023-07-19 14:11:36,451 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:36,452 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775896452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775896452"}]},"ts":"1689775896452"} 2023-07-19 14:11:36,453 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775896452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775896452"}]},"ts":"1689775896452"} 2023-07-19 14:11:36,455 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:36,458 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:36,458 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775896458"}]},"ts":"1689775896458"} 2023-07-19 14:11:36,462 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 14:11:36,473 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:36,475 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:36,475 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:36,475 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:36,475 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:36,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, ASSIGN}] 2023-07-19 14:11:36,480 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, ASSIGN 2023-07-19 14:11:36,480 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, ASSIGN 2023-07-19 14:11:36,493 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:11:36,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:11:36,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:36,643 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:36,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=39a74205fe967b606012a20b09316e8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:36,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7c689e3facd51ed38b9029954e99dd66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:36,646 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775896646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775896646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775896646"}]},"ts":"1689775896646"} 2023-07-19 14:11:36,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775896646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775896646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775896646"}]},"ts":"1689775896646"} 2023-07-19 14:11:36,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 39a74205fe967b606012a20b09316e8f, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:11:36,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 7c689e3facd51ed38b9029954e99dd66, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:36,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39a74205fe967b606012a20b09316e8f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 14:11:36,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c689e3facd51ed38b9029954e99dd66, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 14:11:36,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. service=AccessControlService 2023-07-19 14:11:36,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. service=AccessControlService 2023-07-19 14:11:36,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:36,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:36,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,821 INFO [StoreOpener-7c689e3facd51ed38b9029954e99dd66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,823 INFO [StoreOpener-39a74205fe967b606012a20b09316e8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,824 DEBUG [StoreOpener-7c689e3facd51ed38b9029954e99dd66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf 2023-07-19 14:11:36,824 DEBUG [StoreOpener-7c689e3facd51ed38b9029954e99dd66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf 2023-07-19 14:11:36,825 DEBUG [StoreOpener-39a74205fe967b606012a20b09316e8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf 2023-07-19 14:11:36,825 DEBUG [StoreOpener-39a74205fe967b606012a20b09316e8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf 2023-07-19 14:11:36,825 INFO [StoreOpener-7c689e3facd51ed38b9029954e99dd66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c689e3facd51ed38b9029954e99dd66 columnFamilyName cf 2023-07-19 14:11:36,825 INFO [StoreOpener-39a74205fe967b606012a20b09316e8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39a74205fe967b606012a20b09316e8f columnFamilyName cf 2023-07-19 14:11:36,826 INFO [StoreOpener-7c689e3facd51ed38b9029954e99dd66-1] regionserver.HStore(310): Store=7c689e3facd51ed38b9029954e99dd66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:36,826 INFO [StoreOpener-39a74205fe967b606012a20b09316e8f-1] regionserver.HStore(310): Store=39a74205fe967b606012a20b09316e8f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:36,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:36,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:36,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c689e3facd51ed38b9029954e99dd66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73848575, jitterRate=0.10042952001094818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:36,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:36,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c689e3facd51ed38b9029954e99dd66: 2023-07-19 14:11:36,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39a74205fe967b606012a20b09316e8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74058126, jitterRate=0.10355207324028015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:36,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39a74205fe967b606012a20b09316e8f: 2023-07-19 14:11:36,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66., pid=70, masterSystemTime=1689775896805 2023-07-19 14:11:36,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f., pid=69, masterSystemTime=1689775896805 2023-07-19 14:11:36,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:36,844 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7c689e3facd51ed38b9029954e99dd66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:36,844 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775896844"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775896844"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775896844"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775896844"}]},"ts":"1689775896844"} 2023-07-19 14:11:36,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:36,846 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=39a74205fe967b606012a20b09316e8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:36,846 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775896845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775896845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775896845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775896845"}]},"ts":"1689775896845"} 2023-07-19 14:11:36,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-19 14:11:36,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 7c689e3facd51ed38b9029954e99dd66, server=jenkins-hbase4.apache.org,36051,1689775817079 in 197 msec 2023-07-19 14:11:36,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-19 14:11:36,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 39a74205fe967b606012a20b09316e8f, server=jenkins-hbase4.apache.org,41889,1689775817007 in 199 msec 2023-07-19 14:11:36,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, ASSIGN in 377 msec 2023-07-19 14:11:36,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 14:11:36,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, ASSIGN in 378 msec 2023-07-19 14:11:36,860 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:36,860 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775896860"}]},"ts":"1689775896860"} 2023-07-19 14:11:36,861 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 14:11:36,865 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:36,866 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 14:11:36,869 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 14:11:36,870 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,871 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,871 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,871 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:36,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 551 msec 2023-07-19 14:11:36,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,875 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,876 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:36,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 14:11:36,936 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 14:11:36,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 7c689e3facd51ed38b9029954e99dd66, 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:36,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7c689e3facd51ed38b9029954e99dd66, 39a74205fe967b606012a20b09316e8f], force=true 2023-07-19 14:11:37,001 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7c689e3facd51ed38b9029954e99dd66, 39a74205fe967b606012a20b09316e8f], force=true 2023-07-19 14:11:37,002 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7c689e3facd51ed38b9029954e99dd66, 39a74205fe967b606012a20b09316e8f], force=true 2023-07-19 14:11:37,002 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7c689e3facd51ed38b9029954e99dd66, 39a74205fe967b606012a20b09316e8f], force=true 2023-07-19 14:11:37,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:37,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, UNASSIGN}] 2023-07-19 14:11:37,082 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, UNASSIGN 2023-07-19 14:11:37,083 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=39a74205fe967b606012a20b09316e8f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:37,084 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775897083"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775897083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775897083"}]},"ts":"1689775897083"} 2023-07-19 14:11:37,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 39a74205fe967b606012a20b09316e8f, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:11:37,092 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, UNASSIGN 2023-07-19 14:11:37,094 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7c689e3facd51ed38b9029954e99dd66, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:37,094 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775897094"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775897094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775897094"}]},"ts":"1689775897094"} 2023-07-19 14:11:37,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 7c689e3facd51ed38b9029954e99dd66, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:37,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:37,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:37,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39a74205fe967b606012a20b09316e8f, disabling compactions & flushes 2023-07-19 14:11:37,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:37,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:37,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. after waiting 0 ms 2023-07-19 14:11:37,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:37,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 39a74205fe967b606012a20b09316e8f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 14:11:37,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:37,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c689e3facd51ed38b9029954e99dd66, disabling compactions & flushes 2023-07-19 14:11:37,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:37,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:37,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. after waiting 0 ms 2023-07-19 14:11:37,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:37,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7c689e3facd51ed38b9029954e99dd66 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 14:11:37,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/.tmp/cf/7beae76808b141f0a2d8f6fe5c824f81 2023-07-19 14:11:37,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:37,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/.tmp/cf/7beae76808b141f0a2d8f6fe5c824f81 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf/7beae76808b141f0a2d8f6fe5c824f81 2023-07-19 14:11:37,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf/7beae76808b141f0a2d8f6fe5c824f81, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 14:11:37,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 39a74205fe967b606012a20b09316e8f in 95ms, sequenceid=5, compaction requested=false 2023-07-19 14:11:37,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 14:11:37,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/.tmp/cf/5545ea47e47248279c9ff884eb17583a 2023-07-19 14:11:37,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/.tmp/cf/5545ea47e47248279c9ff884eb17583a as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf/5545ea47e47248279c9ff884eb17583a 2023-07-19 14:11:37,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 14:11:37,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:37,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f. 2023-07-19 14:11:37,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39a74205fe967b606012a20b09316e8f: 2023-07-19 14:11:37,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf/5545ea47e47248279c9ff884eb17583a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 14:11:37,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:37,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7c689e3facd51ed38b9029954e99dd66 in 141ms, sequenceid=5, compaction requested=false 2023-07-19 14:11:37,403 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=39a74205fe967b606012a20b09316e8f, regionState=CLOSED 2023-07-19 14:11:37,403 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775897403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775897403"}]},"ts":"1689775897403"} 2023-07-19 14:11:37,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-19 14:11:37,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 39a74205fe967b606012a20b09316e8f, server=jenkins-hbase4.apache.org,41889,1689775817007 in 324 msec 2023-07-19 14:11:37,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=39a74205fe967b606012a20b09316e8f, UNASSIGN in 339 msec 2023-07-19 14:11:37,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 14:11:37,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:37,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66. 2023-07-19 14:11:37,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c689e3facd51ed38b9029954e99dd66: 2023-07-19 14:11:37,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:37,429 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7c689e3facd51ed38b9029954e99dd66, regionState=CLOSED 2023-07-19 14:11:37,430 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689775897429"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775897429"}]},"ts":"1689775897429"} 2023-07-19 14:11:37,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-19 14:11:37,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 7c689e3facd51ed38b9029954e99dd66, server=jenkins-hbase4.apache.org,36051,1689775817079 in 335 msec 2023-07-19 14:11:37,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 14:11:37,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7c689e3facd51ed38b9029954e99dd66, UNASSIGN in 363 msec 2023-07-19 14:11:37,531 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 14:11:37,535 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896320.7c689e3facd51ed38b9029954e99dd66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:37,535 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689775896320.39a74205fe967b606012a20b09316e8f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:37,535 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:37,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, ASSIGN}] 2023-07-19 14:11:37,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:37,626 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, ASSIGN 2023-07-19 14:11:37,629 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:11:37,780 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 14:11:37,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9f33d51e81802b732b50bcfd6a8bce90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:37,783 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775897783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775897783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775897783"}]},"ts":"1689775897783"} 2023-07-19 14:11:37,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 9f33d51e81802b732b50bcfd6a8bce90, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:37,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:37,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f33d51e81802b732b50bcfd6a8bce90, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.', STARTKEY => '', ENDKEY => ''} 2023-07-19 14:11:37,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. service=AccessControlService 2023-07-19 14:11:37,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:37,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:37,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:37,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:37,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:37,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/.regioninfo 2023-07-19 14:11:37,972 INFO [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:37,974 DEBUG [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf 2023-07-19 14:11:37,974 DEBUG [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf 2023-07-19 14:11:37,974 INFO [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f33d51e81802b732b50bcfd6a8bce90 columnFamilyName cf 2023-07-19 14:11:38,020 DEBUG [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] regionserver.HStore(539): loaded hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/5545ea47e47248279c9ff884eb17583a.7c689e3facd51ed38b9029954e99dd66->hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf/5545ea47e47248279c9ff884eb17583a-top 2023-07-19 14:11:38,040 DEBUG [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] regionserver.HStore(539): loaded hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/7beae76808b141f0a2d8f6fe5c824f81.39a74205fe967b606012a20b09316e8f->hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf/7beae76808b141f0a2d8f6fe5c824f81-top 2023-07-19 14:11:38,040 INFO [StoreOpener-9f33d51e81802b732b50bcfd6a8bce90-1] regionserver.HStore(310): Store=9f33d51e81802b732b50bcfd6a8bce90/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:38,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:38,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:38,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:38,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f33d51e81802b732b50bcfd6a8bce90; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59051934, jitterRate=-0.120057612657547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f33d51e81802b732b50bcfd6a8bce90: 2023-07-19 14:11:38,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90., pid=77, masterSystemTime=1689775897942 2023-07-19 14:11:38,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.,because compaction is disabled. 2023-07-19 14:11:38,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:38,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:38,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9f33d51e81802b732b50bcfd6a8bce90, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,063 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775898063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775898063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775898063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775898063"}]},"ts":"1689775898063"} 2023-07-19 14:11:38,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 14:11:38,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 9f33d51e81802b732b50bcfd6a8bce90, server=jenkins-hbase4.apache.org,36051,1689775817079 in 280 msec 2023-07-19 14:11:38,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 14:11:38,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, ASSIGN in 445 msec 2023-07-19 14:11:38,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7c689e3facd51ed38b9029954e99dd66, 39a74205fe967b606012a20b09316e8f], force=true in 1.0800 sec 2023-07-19 14:11:38,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 14:11:38,127 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 14:11:38,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 14:11:38,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775898128 (current time:1689775898128). 2023-07-19 14:11:38,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:38,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x622d124c to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:38,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ceaf079, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:38,151 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:38,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x622d124c to 127.0.0.1:58621 2023-07-19 14:11:38,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:38,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x2dd7fa42 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:38,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27e232c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:38,225 DEBUG [hconnection-0x1cb0777b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:38,229 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:38,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:38,236 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2dd7fa42 to 127.0.0.1:58621 2023-07-19 14:11:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 14:11:38,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:38,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 14:11:38,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 14:11:38,272 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 14:11:38,273 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689776498273 2023-07-19 14:11:38,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 14:11:38,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,280 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:38,280 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:38,281 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 14:11:38,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 14:11:38,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 41 msec 2023-07-19 14:11:38,290 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 14:11:38,291 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689776498291 2023-07-19 14:11:38,295 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0004_000001 (auth:SIMPLE) 2023-07-19 14:11:38,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,323 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 14:11:38,323 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:38,327 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 14:11:38,327 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 14:11:38,380 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:38,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 14:11:38,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:38,382 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:38,386 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,386 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,423 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:38,423 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:38,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:38,423 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:38,423 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:38,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,423 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,423 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 14:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 14:11:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 14:11:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:38,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,426 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 14:11:38,428 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 14:11:38,428 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 14:11:38,428 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 14:11:38,428 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:38,428 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 14:11:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 14:11:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 14:11:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 14:11:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 14:11:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 14:11:38,470 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,470 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:38,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:38,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 14:11:38,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b345f82[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:38,486 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 14:11:38,486 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 14:11:38,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 14:11:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 14:11:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 14:11:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:38,531 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 14:11:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:38,532 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:38,532 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:38,532 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. started... 2023-07-19 14:11:38,534 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f33d51e81802b732b50bcfd6a8bce90: 2023-07-19 14:11:38,534 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,534 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:38,534 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/5545ea47e47248279c9ff884eb17583a.7c689e3facd51ed38b9029954e99dd66->hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf/5545ea47e47248279c9ff884eb17583a-top, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/7beae76808b141f0a2d8f6fe5c824f81.39a74205fe967b606012a20b09316e8f->hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf/7beae76808b141f0a2d8f6fe5c824f81-top] hfiles 2023-07-19 14:11:38,535 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/5545ea47e47248279c9ff884eb17583a.7c689e3facd51ed38b9029954e99dd66 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,535 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/7beae76808b141f0a2d8f6fe5c824f81.39a74205fe967b606012a20b09316e8f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,548 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. completed. 2023-07-19 14:11:38,548 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:38,548 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:38,548 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:38,548 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,548 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 14:11:38,548 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 14:11:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:38,569 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 14:11:38,582 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:38,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 14:11:38,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:38,583 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 14:11:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 14:11:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 14:11:38,717 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:38,717 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 14:11:38,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:38,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:38,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:38,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:11:38,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 14:11:38,721 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 14:11:38,721 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:38,721 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:38,721 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,721 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:38,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:38,761 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,761 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:38,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:38,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,762 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:38,762 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:38,764 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,765 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,765 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:38,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:38,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:38,816 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:38,816 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,816 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,816 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:38,816 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:38,816 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:38,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:38,816 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:38,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:38,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:38,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:38,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,884 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:38,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 14:11:38,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:38,885 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 14:11:38,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 14:11:38,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,933 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:38,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689775898274Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775898816 (+542 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775898816Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775898820 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689775898834 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689775898932 (+98 ms) 2023-07-19 14:11:38,936 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 14:11:38,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 657 msec 2023-07-19 14:11:39,385 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:39,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 14:11:39,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:39,387 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387 2023-07-19 14:11:39,387 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35063, tgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387, rawTgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:39,414 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:39,414 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1683930355_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:39,414 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 14:11:39,415 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:11:39,432 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:39,537 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,538 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,539 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,539 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,540 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,540 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,541 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,639 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-7760765766343733500.jar 2023-07-19 14:11:39,640 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,640 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,641 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,641 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,642 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,642 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:39,643 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:39,643 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:39,644 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:39,645 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:39,645 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:39,646 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:39,647 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:39,647 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:39,648 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:39,648 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:39,649 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:39,649 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:39,650 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:39,650 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:39,651 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:39,651 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:39,652 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:40,158 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:40,160 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 14:11:40,162 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 14:11:40,247 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:40,247 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:40,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:46,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:48,576 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:52,562 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:54,636 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:11:54,637 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:11:54,663 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:54,663 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:11:54,664 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:11:54,664 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:54,665 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 14:11:54,665 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 14:11:54,665 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:54,665 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 14:11:54,666 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775899387/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 14:11:54,689 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:54,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:54,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 14:11:54,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775914695"}]},"ts":"1689775914695"} 2023-07-19 14:11:54,697 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 14:11:54,700 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 14:11:54,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, UNASSIGN}] 2023-07-19 14:11:54,701 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, UNASSIGN 2023-07-19 14:11:54,702 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9f33d51e81802b732b50bcfd6a8bce90, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:54,702 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775914702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775914702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775914702"}]},"ts":"1689775914702"} 2023-07-19 14:11:54,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 9f33d51e81802b732b50bcfd6a8bce90, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:54,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 14:11:54,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f33d51e81802b732b50bcfd6a8bce90, disabling compactions & flushes 2023-07-19 14:11:54,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. after waiting 0 ms 2023-07-19 14:11:54,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:54,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 14:11:54,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:54,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90. 2023-07-19 14:11:54,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f33d51e81802b732b50bcfd6a8bce90: 2023-07-19 14:11:54,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:54,882 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9f33d51e81802b732b50bcfd6a8bce90, regionState=CLOSED 2023-07-19 14:11:54,882 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689775914882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775914882"}]},"ts":"1689775914882"} 2023-07-19 14:11:54,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 14:11:54,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 9f33d51e81802b732b50bcfd6a8bce90, server=jenkins-hbase4.apache.org,36051,1689775817079 in 180 msec 2023-07-19 14:11:54,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 14:11:54,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f33d51e81802b732b50bcfd6a8bce90, UNASSIGN in 185 msec 2023-07-19 14:11:54,888 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775914888"}]},"ts":"1689775914888"} 2023-07-19 14:11:54,889 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 14:11:54,891 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 14:11:54,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 203 msec 2023-07-19 14:11:55,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 14:11:55,005 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 14:11:55,006 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,011 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,012 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,017 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,028 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:55,031 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/recovered.edits] 2023-07-19 14:11:55,039 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:55,039 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:55,045 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/recovered.edits] 2023-07-19 14:11:55,046 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/recovered.edits] 2023-07-19 14:11:55,057 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/5545ea47e47248279c9ff884eb17583a.7c689e3facd51ed38b9029954e99dd66 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/5545ea47e47248279c9ff884eb17583a.7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:55,058 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf/7beae76808b141f0a2d8f6fe5c824f81 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/cf/7beae76808b141f0a2d8f6fe5c824f81 2023-07-19 14:11:55,059 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf/5545ea47e47248279c9ff884eb17583a to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/cf/5545ea47e47248279c9ff884eb17583a 2023-07-19 14:11:55,062 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/recovered.edits/8.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f/recovered.edits/8.seqid 2023-07-19 14:11:55,062 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:55,064 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/recovered.edits/8.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66/recovered.edits/8.seqid 2023-07-19 14:11:55,064 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7c689e3facd51ed38b9029954e99dd66 2023-07-19 14:11:55,070 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/7beae76808b141f0a2d8f6fe5c824f81.39a74205fe967b606012a20b09316e8f to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/cf/7beae76808b141f0a2d8f6fe5c824f81.39a74205fe967b606012a20b09316e8f 2023-07-19 14:11:55,075 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/recovered.edits/12.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90/recovered.edits/12.seqid 2023-07-19 14:11:55,076 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f33d51e81802b732b50bcfd6a8bce90 2023-07-19 14:11:55,076 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 14:11:55,079 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,082 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 14:11:55,094 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 14:11:55,095 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,096 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 14:11:55,096 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775915096"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:55,110 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 14:11:55,111 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9f33d51e81802b732b50bcfd6a8bce90, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689775896321.9f33d51e81802b732b50bcfd6a8bce90.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 14:11:55,111 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 14:11:55,111 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775915111"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:55,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 14:11:55,132 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,132 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,132 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,132 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:55,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:55,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:55,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 14:11:55,163 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 157 msec 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,171 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 14:11:55,172 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 14:11:55,172 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,177 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:55,177 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:55,177 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:55,177 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:55,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 14:11:55,179 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775915179"}]},"ts":"1689775915179"} 2023-07-19 14:11:55,181 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 14:11:55,183 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 14:11:55,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, UNASSIGN}] 2023-07-19 14:11:55,186 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, UNASSIGN 2023-07-19 14:11:55,186 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, UNASSIGN 2023-07-19 14:11:55,189 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9c7b3f44da65ff04ede45adb1a0aeaf4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:55,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=80b004c9c9a80fcb0cad6c84c79af13b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:55,190 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775915189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775915189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775915189"}]},"ts":"1689775915189"} 2023-07-19 14:11:55,190 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775915189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775915189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775915189"}]},"ts":"1689775915189"} 2023-07-19 14:11:55,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9c7b3f44da65ff04ede45adb1a0aeaf4, server=jenkins-hbase4.apache.org,34059,1689775817131}] 2023-07-19 14:11:55,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 80b004c9c9a80fcb0cad6c84c79af13b, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:55,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 14:11:55,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:55,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c7b3f44da65ff04ede45adb1a0aeaf4, disabling compactions & flushes 2023-07-19 14:11:55,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:55,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:55,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. after waiting 0 ms 2023-07-19 14:11:55,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:55,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:55,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80b004c9c9a80fcb0cad6c84c79af13b, disabling compactions & flushes 2023-07-19 14:11:55,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:55,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:55,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. after waiting 0 ms 2023-07-19 14:11:55,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:55,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:55,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:55,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4. 2023-07-19 14:11:55,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c7b3f44da65ff04ede45adb1a0aeaf4: 2023-07-19 14:11:55,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:55,379 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9c7b3f44da65ff04ede45adb1a0aeaf4, regionState=CLOSED 2023-07-19 14:11:55,379 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775915379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775915379"}]},"ts":"1689775915379"} 2023-07-19 14:11:55,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 14:11:55,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9c7b3f44da65ff04ede45adb1a0aeaf4, server=jenkins-hbase4.apache.org,34059,1689775817131 in 190 msec 2023-07-19 14:11:55,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9c7b3f44da65ff04ede45adb1a0aeaf4, UNASSIGN in 201 msec 2023-07-19 14:11:55,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:11:55,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:11:55,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b. 2023-07-19 14:11:55,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80b004c9c9a80fcb0cad6c84c79af13b: 2023-07-19 14:11:55,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:55,392 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=80b004c9c9a80fcb0cad6c84c79af13b, regionState=CLOSED 2023-07-19 14:11:55,392 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689775915392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775915392"}]},"ts":"1689775915392"} 2023-07-19 14:11:55,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 14:11:55,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 80b004c9c9a80fcb0cad6c84c79af13b, server=jenkins-hbase4.apache.org,36051,1689775817079 in 194 msec 2023-07-19 14:11:55,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 14:11:55,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=80b004c9c9a80fcb0cad6c84c79af13b, UNASSIGN in 213 msec 2023-07-19 14:11:55,399 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775915399"}]},"ts":"1689775915399"} 2023-07-19 14:11:55,401 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 14:11:55,403 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 14:11:55,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 231 msec 2023-07-19 14:11:55,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 14:11:55,482 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 14:11:55,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,494 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,496 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,497 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,500 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,500 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,500 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,500 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 14:11:55,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 14:11:55,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 14:11:55,502 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:55,502 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:55,502 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,502 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,503 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,503 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 14:11:55,503 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,503 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 14:11:55,503 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,503 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 14:11:55,507 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/recovered.edits] 2023-07-19 14:11:55,507 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/recovered.edits] 2023-07-19 14:11:55,515 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf/57010d39f8bf4600aa0267bcb6e85865 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/cf/57010d39f8bf4600aa0267bcb6e85865 2023-07-19 14:11:55,516 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf/edf5527606b54661b43bfe4214147834 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/cf/edf5527606b54661b43bfe4214147834 2023-07-19 14:11:55,520 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4/recovered.edits/9.seqid 2023-07-19 14:11:55,520 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b/recovered.edits/9.seqid 2023-07-19 14:11:55,521 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9c7b3f44da65ff04ede45adb1a0aeaf4 2023-07-19 14:11:55,521 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/80b004c9c9a80fcb0cad6c84c79af13b 2023-07-19 14:11:55,521 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 14:11:55,529 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,535 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 14:11:55,537 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 14:11:55,539 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,539 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 14:11:55,539 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775915539"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:55,539 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775915539"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:55,541 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:11:55,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c7b3f44da65ff04ede45adb1a0aeaf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689775894075.9c7b3f44da65ff04ede45adb1a0aeaf4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 80b004c9c9a80fcb0cad6c84c79af13b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689775894075.80b004c9c9a80fcb0cad6c84c79af13b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:11:55,541 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 14:11:55,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775915541"}]},"ts":"9223372036854775807"} 2023-07-19 14:11:55,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 14:11:55,547 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 64 msec 2023-07-19 14:11:55,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 14:11:55,606 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 14:11:55,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 14:11:55,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,620 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 14:11:55,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 14:11:55,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 14:11:55,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 14:11:55,665 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1094090041_1 at /127.0.0.1:33042 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1094090041_1 at /127.0.0.1:54698 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:51078 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:33064 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:54712 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:35197 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=548 (was 412) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=2063 (was 3256) 2023-07-19 14:11:55,665 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 14:11:55,697 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=548, ProcessCount=187, AvailableMemoryMB=2051 2023-07-19 14:11:55,697 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 14:11:55,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:11:55,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:11:55,711 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:11:55,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 14:11:55,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:11:55,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:55,714 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:55,714 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:55,715 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 empty. 2023-07-19 14:11:55,715 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a empty. 2023-07-19 14:11:55,715 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:55,716 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:55,716 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 14:11:55,756 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 14:11:55,758 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5f810fb01b2ac64d06eba34859196007, NAME => 'testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:55,758 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 444894088392e94dd4b6a4137f561a0a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:11:55,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:55,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:55,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 444894088392e94dd4b6a4137f561a0a, disabling compactions & flushes 2023-07-19 14:11:55,836 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:55,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:55,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. after waiting 0 ms 2023-07-19 14:11:55,836 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:55,836 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:55,837 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 444894088392e94dd4b6a4137f561a0a: 2023-07-19 14:11:55,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:55,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5f810fb01b2ac64d06eba34859196007, disabling compactions & flushes 2023-07-19 14:11:55,844 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:55,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:55,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. after waiting 0 ms 2023-07-19 14:11:55,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:55,845 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:55,845 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5f810fb01b2ac64d06eba34859196007: 2023-07-19 14:11:55,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:11:55,849 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775915849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775915849"}]},"ts":"1689775915849"} 2023-07-19 14:11:55,849 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775915849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775915849"}]},"ts":"1689775915849"} 2023-07-19 14:11:55,852 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:11:55,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:11:55,853 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775915853"}]},"ts":"1689775915853"} 2023-07-19 14:11:55,857 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 14:11:55,862 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:11:55,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:11:55,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:11:55,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:11:55,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:11:55,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, ASSIGN}] 2023-07-19 14:11:55,867 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, ASSIGN 2023-07-19 14:11:55,867 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, ASSIGN 2023-07-19 14:11:55,868 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:11:55,868 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:11:56,018 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:11:56,021 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5f810fb01b2ac64d06eba34859196007, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,021 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=444894088392e94dd4b6a4137f561a0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,021 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775916021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775916021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775916021"}]},"ts":"1689775916021"} 2023-07-19 14:11:56,021 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775916021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775916021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775916021"}]},"ts":"1689775916021"} 2023-07-19 14:11:56,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 5f810fb01b2ac64d06eba34859196007, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:11:56,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 444894088392e94dd4b6a4137f561a0a, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:11:56,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:56,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:56,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 444894088392e94dd4b6a4137f561a0a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:11:56,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f810fb01b2ac64d06eba34859196007, NAME => 'testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:11:56,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. service=AccessControlService 2023-07-19 14:11:56,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. service=AccessControlService 2023-07-19 14:11:56,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:56,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,184 INFO [StoreOpener-5f810fb01b2ac64d06eba34859196007-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,184 INFO [StoreOpener-444894088392e94dd4b6a4137f561a0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,185 DEBUG [StoreOpener-5f810fb01b2ac64d06eba34859196007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf 2023-07-19 14:11:56,185 DEBUG [StoreOpener-5f810fb01b2ac64d06eba34859196007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf 2023-07-19 14:11:56,185 DEBUG [StoreOpener-444894088392e94dd4b6a4137f561a0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf 2023-07-19 14:11:56,185 DEBUG [StoreOpener-444894088392e94dd4b6a4137f561a0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf 2023-07-19 14:11:56,186 INFO [StoreOpener-5f810fb01b2ac64d06eba34859196007-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f810fb01b2ac64d06eba34859196007 columnFamilyName cf 2023-07-19 14:11:56,186 INFO [StoreOpener-444894088392e94dd4b6a4137f561a0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 444894088392e94dd4b6a4137f561a0a columnFamilyName cf 2023-07-19 14:11:56,186 INFO [StoreOpener-5f810fb01b2ac64d06eba34859196007-1] regionserver.HStore(310): Store=5f810fb01b2ac64d06eba34859196007/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:56,187 INFO [StoreOpener-444894088392e94dd4b6a4137f561a0a-1] regionserver.HStore(310): Store=444894088392e94dd4b6a4137f561a0a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:11:56,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:11:56,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:11:56,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:56,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:11:56,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 444894088392e94dd4b6a4137f561a0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59537515, jitterRate=-0.11282189190387726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:56,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 444894088392e94dd4b6a4137f561a0a: 2023-07-19 14:11:56,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f810fb01b2ac64d06eba34859196007; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63393835, jitterRate=-0.055358245968818665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:11:56,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f810fb01b2ac64d06eba34859196007: 2023-07-19 14:11:56,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a., pid=94, masterSystemTime=1689775916177 2023-07-19 14:11:56,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007., pid=93, masterSystemTime=1689775916175 2023-07-19 14:11:56,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:56,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:56,196 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=444894088392e94dd4b6a4137f561a0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,196 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775916195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775916195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775916195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775916195"}]},"ts":"1689775916195"} 2023-07-19 14:11:56,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,196 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5f810fb01b2ac64d06eba34859196007, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775916196"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775916196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775916196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775916196"}]},"ts":"1689775916196"} 2023-07-19 14:11:56,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 14:11:56,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 444894088392e94dd4b6a4137f561a0a, server=jenkins-hbase4.apache.org,36051,1689775817079 in 173 msec 2023-07-19 14:11:56,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 14:11:56,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 5f810fb01b2ac64d06eba34859196007, server=jenkins-hbase4.apache.org,41889,1689775817007 in 175 msec 2023-07-19 14:11:56,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, ASSIGN in 336 msec 2023-07-19 14:11:56,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 14:11:56,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, ASSIGN in 336 msec 2023-07-19 14:11:56,202 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:11:56,202 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775916202"}]},"ts":"1689775916202"} 2023-07-19 14:11:56,204 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 14:11:56,211 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:11:56,211 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 14:11:56,213 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:11:56,214 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:56,214 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:56,214 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:56,214 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:11:56,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:56,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:56,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:56,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 14:11:56,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 518 msec 2023-07-19 14:11:56,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 14:11:56,328 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 14:11:56,329 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 14:11:56,329 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:56,333 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 14:11:56,333 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:56,333 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-19 14:11:56,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:56,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775916337 (current time:1689775916337). 2023-07-19 14:11:56,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:56,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x39a5825f to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:56,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c3d9ed6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:56,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:56,354 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:56,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39a5825f to 127.0.0.1:58621 2023-07-19 14:11:56,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:56,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x32a5b2f6 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:56,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27077987, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:56,373 DEBUG [hconnection-0x375c989f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:56,377 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:56,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:56,385 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:56,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32a5b2f6 to 127.0.0.1:58621 2023-07-19 14:11:56,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:56,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:11:56,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:56,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:56,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:56,397 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:56,398 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776516398 2023-07-19 14:11:56,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:56,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:56,399 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:56,399 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:56,400 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:56,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:56,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-19 14:11:56,408 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:56,408 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776516408 2023-07-19 14:11:56,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,431 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 14:11:56,431 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,440 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 14:11:56,440 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:11:56,440 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,440 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,445 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,446 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,446 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,446 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,446 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:56,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:56,447 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:56,447 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:56,448 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,450 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:56,450 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:56,449 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:56,450 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:56,450 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:56,450 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,450 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,452 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:56,454 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,454 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,455 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,455 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,455 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,455 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:56,455 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,455 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:56,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f953cc[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:11:56,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41f953cc[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:56,462 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:11:56,462 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,463 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,463 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:56,463 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:56,464 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,464 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:56,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,464 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:56,464 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:56,464 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:56,464 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,464 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. started... 2023-07-19 14:11:56,465 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,465 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:56,466 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:56,466 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:56,466 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:56,466 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:56,466 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:56,467 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:56,467 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. started... 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 444894088392e94dd4b6a4137f561a0a: 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f810fb01b2ac64d06eba34859196007: 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:56,475 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:11:56,489 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. completed. 2023-07-19 14:11:56,489 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:56,489 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:56,489 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:56,491 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. completed. 2023-07-19 14:11:56,491 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:56,493 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,493 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,493 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:56,493 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:56,495 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,495 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:56,495 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:56,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,495 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:56,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:11:56,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:11:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,500 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:56,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:56,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:56,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,501 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:56,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:11:56,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:11:56,503 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 14:11:56,504 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:56,504 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:56,504 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,504 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:56,505 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,505 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,505 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:56,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,505 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:56,506 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:56,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,507 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,508 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,509 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,510 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,510 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:56,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,513 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:56,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,515 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,515 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:56,513 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:56,515 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,516 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,516 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,516 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,516 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,516 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:56,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:56,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:56,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 14:11:56,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,575 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689775916398Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689775916513 (+115 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689775916515 (+2 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689775916520 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689775916544 (+24 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689775916575 (+31 ms) 2023-07-19 14:11:56,579 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:56,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 180 msec 2023-07-19 14:11:56,701 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:56,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:56,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:56,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:56,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36051] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:11:56,727 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:56,727 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,729 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:11:56,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:56,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775916740 (current time:1689775916740). 2023-07-19 14:11:56,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:11:56,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x1abad015 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:56,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49713bbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:56,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:56,782 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:56,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1abad015 to 127.0.0.1:58621 2023-07-19 14:11:56,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:56,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x3f34d8f0 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:11:56,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73428d7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:11:56,826 DEBUG [hconnection-0x33aeec7d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:56,827 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:56,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:11:56,838 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:11:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f34d8f0 to 127.0.0.1:58621 2023-07-19 14:11:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:11:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 14:11:56,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:11:56,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:56,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:56,846 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:56,855 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689776516855 2023-07-19 14:11:56,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 14:11:56,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 14:11:56,855 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:11:56,856 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:11:56,859 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 14:11:56,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:56,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-19 14:11:56,861 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:56,862 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689776516862 2023-07-19 14:11:56,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,875 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 14:11:56,875 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,877 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 14:11:56,877 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 14:11:56,943 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,943 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,944 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,944 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,944 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,944 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:56,945 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,945 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,946 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:56,947 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,948 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:56,948 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 14:11:56,948 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,948 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:11:56,948 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:56,949 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:56,952 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 14:11:56,954 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,954 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,956 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,956 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:56,956 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:11:56,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:56,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:56,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,957 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:11:56,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d408526[Count = 1] remaining members to acquire global barrier 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:56,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:56,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 14:11:56,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d408526[Count = 0] remaining members to acquire global barrier 2023-07-19 14:11:56,960 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 14:11:56,961 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:56,964 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:56,964 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:56,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 14:11:56,965 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:56,965 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:56,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:11:56,965 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:56,965 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:11:56,965 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:56,965 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:11:56,965 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. started... 2023-07-19 14:11:56,965 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:56,965 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:11:56,965 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. started... 2023-07-19 14:11:56,965 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f810fb01b2ac64d06eba34859196007 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 14:11:56,965 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 444894088392e94dd4b6a4137f561a0a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 14:11:56,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:56,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:56,966 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:56,997 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/.tmp/cf/d45753f6fe444761b863f3858c3015bb 2023-07-19 14:11:57,013 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/.tmp/cf/d45753f6fe444761b863f3858c3015bb as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf/d45753f6fe444761b863f3858c3015bb 2023-07-19 14:11:57,023 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf/d45753f6fe444761b863f3858c3015bb, entries=4, sequenceid=6, filesize=5.1 K 2023-07-19 14:11:57,024 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5f810fb01b2ac64d06eba34859196007 in 59ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:57,024 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 14:11:57,024 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f810fb01b2ac64d06eba34859196007: 2023-07-19 14:11:57,025 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,025 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:57,025 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf/d45753f6fe444761b863f3858c3015bb] hfiles 2023-07-19 14:11:57,025 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf/d45753f6fe444761b863f3858c3015bb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,045 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. completed. 2023-07-19 14:11:57,045 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:11:57,045 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:57,045 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:57,045 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,046 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:57,046 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:11:57,048 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:11:57,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 14:11:57,157 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:57,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:57,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:57,159 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:11:57,387 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/.tmp/cf/e9d989d7b4044256b4776debf00d3f0d 2023-07-19 14:11:57,395 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/.tmp/cf/e9d989d7b4044256b4776debf00d3f0d as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf/e9d989d7b4044256b4776debf00d3f0d 2023-07-19 14:11:57,401 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf/e9d989d7b4044256b4776debf00d3f0d, entries=46, sequenceid=6, filesize=7.9 K 2023-07-19 14:11:57,402 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 444894088392e94dd4b6a4137f561a0a in 437ms, sequenceid=6, compaction requested=false 2023-07-19 14:11:57,404 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 444894088392e94dd4b6a4137f561a0a: 2023-07-19 14:11:57,405 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,405 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:11:57,405 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf/e9d989d7b4044256b4776debf00d3f0d] hfiles 2023-07-19 14:11:57,405 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf/e9d989d7b4044256b4776debf00d3f0d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,425 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. completed. 2023-07-19 14:11:57,425 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:11:57,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:11:57,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:11:57,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 14:11:57,425 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:11:57,428 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 14:11:57,428 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,428 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:57,428 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 14:11:57,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:57,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:57,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:11:57,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 14:11:57,434 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 14:11:57,434 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:11:57,434 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:11:57,434 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,434 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:57,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:57,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:11:57,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:57,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,436 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,437 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,437 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:11:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,439 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:11:57,439 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,440 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:11:57,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:57,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,443 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:57,443 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:57,443 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:57,443 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,442 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:11:57,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:11:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:57,443 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:11:57,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:11:57,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,443 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:11:57,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,443 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:11:57,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:11:57,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,445 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:57,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:57,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:57,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:57,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:11:57,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:11:57,459 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:57,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:57,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:11:57,460 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 14:11:57,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 14:11:57,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,510 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689775916855Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689775917443 (+588 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689775917445 (+2 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689775917451 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689775917463 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689775917510 (+47 ms) 2023-07-19 14:11:57,516 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 14:11:57,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 659 msec 2023-07-19 14:11:57,960 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:11:57,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 14:11:57,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:11:57,962 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962 2023-07-19 14:11:57,962 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35063, tgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962, rawTgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:57,997 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:11:57,997 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_737390032_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:57,997 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 14:11:58,004 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:11:58,071 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,072 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,072 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,072 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,073 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,073 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,073 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,167 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-8045164179083776570.jar 2023-07-19 14:11:58,167 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,168 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,168 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,169 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,169 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,169 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:11:58,170 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:11:58,170 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:11:58,170 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:11:58,171 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:11:58,171 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:11:58,172 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:11:58,173 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:11:58,173 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:11:58,173 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:11:58,174 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:11:58,175 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:58,175 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:58,176 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:58,176 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:58,176 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:11:58,177 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:58,178 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:11:58,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0005_000001 (auth:SIMPLE) 2023-07-19 14:11:59,664 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:11:59,667 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 14:11:59,774 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:59,774 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:11:59,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0006_000001 (auth:SIMPLE) 2023-07-19 14:12:00,467 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:12:05,675 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0006_000001 (auth:SIMPLE) 2023-07-19 14:12:09,109 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:12:09,110 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:12:09,126 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:09,126 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:12:09,127 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:12:09,127 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:09,127 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 14:12:09,128 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 14:12:09,128 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:09,128 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 14:12:09,128 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775917962/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 14:12:09,135 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 14:12:09,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775929140"}]},"ts":"1689775929140"} 2023-07-19 14:12:09,143 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 14:12:09,146 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 14:12:09,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, UNASSIGN}] 2023-07-19 14:12:09,150 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, UNASSIGN 2023-07-19 14:12:09,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, UNASSIGN 2023-07-19 14:12:09,152 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5f810fb01b2ac64d06eba34859196007, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:09,152 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775929152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775929152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775929152"}]},"ts":"1689775929152"} 2023-07-19 14:12:09,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=444894088392e94dd4b6a4137f561a0a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:09,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775929152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775929152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775929152"}]},"ts":"1689775929152"} 2023-07-19 14:12:09,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 5f810fb01b2ac64d06eba34859196007, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:12:09,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 444894088392e94dd4b6a4137f561a0a, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:12:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 14:12:09,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:12:09,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:12:09,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 444894088392e94dd4b6a4137f561a0a, disabling compactions & flushes 2023-07-19 14:12:09,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:12:09,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:12:09,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. after waiting 0 ms 2023-07-19 14:12:09,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:12:09,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f810fb01b2ac64d06eba34859196007, disabling compactions & flushes 2023-07-19 14:12:09,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:12:09,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:12:09,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. after waiting 0 ms 2023-07-19 14:12:09,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:12:09,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:09,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:09,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:09,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a. 2023-07-19 14:12:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 444894088392e94dd4b6a4137f561a0a: 2023-07-19 14:12:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:09,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007. 2023-07-19 14:12:09,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f810fb01b2ac64d06eba34859196007: 2023-07-19 14:12:09,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 444894088392e94dd4b6a4137f561a0a 2023-07-19 14:12:09,364 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=444894088392e94dd4b6a4137f561a0a, regionState=CLOSED 2023-07-19 14:12:09,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775929364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775929364"}]},"ts":"1689775929364"} 2023-07-19 14:12:09,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f810fb01b2ac64d06eba34859196007 2023-07-19 14:12:09,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5f810fb01b2ac64d06eba34859196007, regionState=CLOSED 2023-07-19 14:12:09,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689775929366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775929366"}]},"ts":"1689775929366"} 2023-07-19 14:12:09,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 14:12:09,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 444894088392e94dd4b6a4137f561a0a, server=jenkins-hbase4.apache.org,36051,1689775817079 in 216 msec 2023-07-19 14:12:09,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 14:12:09,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 5f810fb01b2ac64d06eba34859196007, server=jenkins-hbase4.apache.org,41889,1689775817007 in 220 msec 2023-07-19 14:12:09,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=444894088392e94dd4b6a4137f561a0a, UNASSIGN in 229 msec 2023-07-19 14:12:09,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 14:12:09,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5f810fb01b2ac64d06eba34859196007, UNASSIGN in 232 msec 2023-07-19 14:12:09,384 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775929384"}]},"ts":"1689775929384"} 2023-07-19 14:12:09,386 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 14:12:09,388 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 14:12:09,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 254 msec 2023-07-19 14:12:09,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 14:12:09,442 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 14:12:09,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,450 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,453 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,457 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,457 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,457 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,457 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,457 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:09,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:09,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:09,458 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 14:12:09,459 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,460 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:09,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 14:12:09,473 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 2023-07-19 14:12:09,473 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a 2023-07-19 14:12:09,476 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/recovered.edits] 2023-07-19 14:12:09,478 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/recovered.edits] 2023-07-19 14:12:09,493 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf/e9d989d7b4044256b4776debf00d3f0d to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/cf/e9d989d7b4044256b4776debf00d3f0d 2023-07-19 14:12:09,501 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf/d45753f6fe444761b863f3858c3015bb to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/cf/d45753f6fe444761b863f3858c3015bb 2023-07-19 14:12:09,502 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a/recovered.edits/9.seqid 2023-07-19 14:12:09,503 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/444894088392e94dd4b6a4137f561a0a 2023-07-19 14:12:09,507 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007/recovered.edits/9.seqid 2023-07-19 14:12:09,509 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testEmptyExportFileSystemState/5f810fb01b2ac64d06eba34859196007 2023-07-19 14:12:09,509 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 14:12:09,512 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,522 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 14:12:09,541 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 14:12:09,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 14:12:09,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775929543"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:09,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775929543"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:09,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 14:12:09,565 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:12:09,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5f810fb01b2ac64d06eba34859196007, NAME => 'testtb-testEmptyExportFileSystemState,,1689775915699.5f810fb01b2ac64d06eba34859196007.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 444894088392e94dd4b6a4137f561a0a, NAME => 'testtb-testEmptyExportFileSystemState,1,1689775915699.444894088392e94dd4b6a4137f561a0a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:12:09,565 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 14:12:09,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775929565"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:09,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 14:12:09,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 14:12:09,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 140 msec 2023-07-19 14:12:09,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 14:12:09,768 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 14:12:09,798 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 14:12:09,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:09,808 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 14:12:09,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 14:12:09,853 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1373785924_1 at /127.0.0.1:33798 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:45907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1373785924_1 at /127.0.0.1:35840 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4595 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:45199 from appattempt_1689775825603_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:33812 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:39685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:47830 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:35862 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=585 (was 548) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 187), AvailableMemoryMB=1583 (was 2051) 2023-07-19 14:12:09,853 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 14:12:09,882 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=585, ProcessCount=184, AvailableMemoryMB=1580 2023-07-19 14:12:09,882 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 14:12:09,884 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 14:12:09,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:09,888 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 14:12:09,888 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 14:12:09,890 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 14:12:09,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:09,895 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:09,895 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:09,896 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 empty. 2023-07-19 14:12:09,896 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 empty. 2023-07-19 14:12:09,896 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:09,896 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:09,896 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 14:12:09,967 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 14:12:09,969 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef9a53d48fe7b383cf81e90f875d1ee6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:12:09,970 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 592c35859d3bc6a3c4163fa08e139719, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp 2023-07-19 14:12:09,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:10,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:10,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 592c35859d3bc6a3c4163fa08e139719, disabling compactions & flushes 2023-07-19 14:12:10,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. after waiting 0 ms 2023-07-19 14:12:10,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 592c35859d3bc6a3c4163fa08e139719: 2023-07-19 14:12:10,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:10,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ef9a53d48fe7b383cf81e90f875d1ee6, disabling compactions & flushes 2023-07-19 14:12:10,085 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. after waiting 0 ms 2023-07-19 14:12:10,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,085 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,085 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ef9a53d48fe7b383cf81e90f875d1ee6: 2023-07-19 14:12:10,089 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 14:12:10,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775930093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775930093"}]},"ts":"1689775930093"} 2023-07-19 14:12:10,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775930093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775930093"}]},"ts":"1689775930093"} 2023-07-19 14:12:10,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 14:12:10,104 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 14:12:10,104 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775930104"}]},"ts":"1689775930104"} 2023-07-19 14:12:10,106 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 14:12:10,110 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 14:12:10,112 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 14:12:10,112 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 14:12:10,112 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 14:12:10,112 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 14:12:10,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, ASSIGN}] 2023-07-19 14:12:10,117 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, ASSIGN 2023-07-19 14:12:10,117 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, ASSIGN 2023-07-19 14:12:10,119 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41889,1689775817007; forceNewPlan=false, retain=false 2023-07-19 14:12:10,120 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36051,1689775817079; forceNewPlan=false, retain=false 2023-07-19 14:12:10,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:10,269 INFO [jenkins-hbase4:35343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 14:12:10,275 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ef9a53d48fe7b383cf81e90f875d1ee6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:10,276 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775930275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775930275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775930275"}]},"ts":"1689775930275"} 2023-07-19 14:12:10,276 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=592c35859d3bc6a3c4163fa08e139719, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:10,276 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775930276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775930276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775930276"}]},"ts":"1689775930276"} 2023-07-19 14:12:10,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure ef9a53d48fe7b383cf81e90f875d1ee6, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:12:10,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 592c35859d3bc6a3c4163fa08e139719, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:12:10,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef9a53d48fe7b383cf81e90f875d1ee6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 14:12:10,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. service=AccessControlService 2023-07-19 14:12:10,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:12:10,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:10,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,440 INFO [StoreOpener-ef9a53d48fe7b383cf81e90f875d1ee6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,443 DEBUG [StoreOpener-ef9a53d48fe7b383cf81e90f875d1ee6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf 2023-07-19 14:12:10,443 DEBUG [StoreOpener-ef9a53d48fe7b383cf81e90f875d1ee6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf 2023-07-19 14:12:10,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 592c35859d3bc6a3c4163fa08e139719, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 14:12:10,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. service=AccessControlService 2023-07-19 14:12:10,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 14:12:10,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 14:12:10,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,445 INFO [StoreOpener-ef9a53d48fe7b383cf81e90f875d1ee6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef9a53d48fe7b383cf81e90f875d1ee6 columnFamilyName cf 2023-07-19 14:12:10,446 INFO [StoreOpener-ef9a53d48fe7b383cf81e90f875d1ee6-1] regionserver.HStore(310): Store=ef9a53d48fe7b383cf81e90f875d1ee6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:12:10,447 INFO [StoreOpener-592c35859d3bc6a3c4163fa08e139719-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,450 DEBUG [StoreOpener-592c35859d3bc6a3c4163fa08e139719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf 2023-07-19 14:12:10,450 DEBUG [StoreOpener-592c35859d3bc6a3c4163fa08e139719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf 2023-07-19 14:12:10,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:10,452 INFO [StoreOpener-592c35859d3bc6a3c4163fa08e139719-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 592c35859d3bc6a3c4163fa08e139719 columnFamilyName cf 2023-07-19 14:12:10,453 INFO [StoreOpener-592c35859d3bc6a3c4163fa08e139719-1] regionserver.HStore(310): Store=592c35859d3bc6a3c4163fa08e139719/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 14:12:10,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:12:10,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef9a53d48fe7b383cf81e90f875d1ee6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72644922, jitterRate=0.08249369263648987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:12:10,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef9a53d48fe7b383cf81e90f875d1ee6: 2023-07-19 14:12:10,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:10,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6., pid=108, masterSystemTime=1689775930433 2023-07-19 14:12:10,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:10,462 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ef9a53d48fe7b383cf81e90f875d1ee6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:10,462 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775930462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775930462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775930462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775930462"}]},"ts":"1689775930462"} 2023-07-19 14:12:10,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 14:12:10,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure ef9a53d48fe7b383cf81e90f875d1ee6, server=jenkins-hbase4.apache.org,41889,1689775817007 in 184 msec 2023-07-19 14:12:10,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, ASSIGN in 356 msec 2023-07-19 14:12:10,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 14:12:10,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 592c35859d3bc6a3c4163fa08e139719; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60349413, jitterRate=-0.10072366893291473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 14:12:10,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 592c35859d3bc6a3c4163fa08e139719: 2023-07-19 14:12:10,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719., pid=109, masterSystemTime=1689775930440 2023-07-19 14:12:10,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:10,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=592c35859d3bc6a3c4163fa08e139719, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:10,490 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775930489"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689775930489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689775930489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689775930489"}]},"ts":"1689775930489"} 2023-07-19 14:12:10,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 14:12:10,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 592c35859d3bc6a3c4163fa08e139719, server=jenkins-hbase4.apache.org,36051,1689775817079 in 210 msec 2023-07-19 14:12:10,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 14:12:10,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, ASSIGN in 381 msec 2023-07-19 14:12:10,497 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 14:12:10,497 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775930497"}]},"ts":"1689775930497"} 2023-07-19 14:12:10,499 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 14:12:10,503 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 14:12:10,503 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 14:12:10,505 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 14:12:10,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:10,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:10,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:10,506 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:10,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:10,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:10,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:10,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:10,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 14:12:10,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 624 msec 2023-07-19 14:12:11,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 14:12:11,009 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 14:12:11,009 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-19 14:12:11,009 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:12:11,012 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-19 14:12:11,012 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:12:11,012 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-19 14:12:11,014 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775931014 (current time:1689775931014). 2023-07-19 14:12:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:12:11,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x79dc3013 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:11,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20373f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:11,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:11,025 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:11,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79dc3013 to 127.0.0.1:58621 2023-07-19 14:12:11,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:11,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x6df4265a to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:11,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7530cf5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:11,033 DEBUG [hconnection-0x6c678040-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:11,036 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:11,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:11,042 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:11,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6df4265a to 127.0.0.1:58621 2023-07-19 14:12:11,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:11,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 14:12:11,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:12:11,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:11,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:11,047 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:11,048 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689776531048 2023-07-19 14:12:11,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:11,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,049 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:12:11,049 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:12:11,050 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:11,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:11,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-19 14:12:11,052 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:11,055 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689776531055 2023-07-19 14:12:11,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,071 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 14:12:11,072 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,073 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 14:12:11,073 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 14:12:11,146 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,147 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,149 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:11,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:11,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:11,150 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:12:11,152 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,152 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,152 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,152 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,154 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,154 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,154 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,155 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:11,158 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:11,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,159 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:11,159 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,161 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:11,161 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:11,161 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:11,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,162 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:11,162 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,162 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:11,163 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:11,164 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:11,164 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,164 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:11,165 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:11,165 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:11,165 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:11,169 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:11,170 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,170 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,171 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:11,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77acacee[Count = 1] remaining members to acquire global barrier 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:11,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77acacee[Count = 0] remaining members to acquire global barrier 2023-07-19 14:12:11,175 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 14:12:11,175 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,177 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,177 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,177 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,178 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,178 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:11,178 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,178 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:12:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,178 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:11,178 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,178 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:12:11,178 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:11,178 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:11,179 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:11,179 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:11,179 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:11,179 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:11,179 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:11,179 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. started... 2023-07-19 14:12:11,179 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. started... 2023-07-19 14:12:11,180 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 592c35859d3bc6a3c4163fa08e139719: 2023-07-19 14:12:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,180 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,180 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:11,181 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef9a53d48fe7b383cf81e90f875d1ee6: 2023-07-19 14:12:11,181 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:11,181 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:12:11,182 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,182 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:11,182 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 14:12:11,196 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. completed. 2023-07-19 14:12:11,197 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:11,197 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:12:11,199 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:11,199 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,199 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:11,199 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,201 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. completed. 2023-07-19 14:12:11,201 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:11,201 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:11,202 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:11,202 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,202 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:11,202 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:12:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,203 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:11,203 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,203 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:11,206 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:12:11,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 14:12:11,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:12:11,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 14:12:11,219 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 14:12:11,219 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:12:11,219 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:12:11,219 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,219 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,223 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,227 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,227 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,228 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,230 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,235 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,235 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,239 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,240 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,242 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,240 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,242 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,243 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,243 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,243 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,243 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,243 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,243 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,351 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:11,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:11,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:11,352 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 14:12:11,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 14:12:11,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,395 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689775931048Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775931243 (+195 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775931243Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775931255 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689775931303 (+48 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689775931394 (+91 ms) 2023-07-19 14:12:11,399 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:11,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 350 msec 2023-07-19 14:12:11,652 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:11,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:11,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:12:11,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:12:11,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36051] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 14:12:11,671 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,671 DEBUG [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:11,672 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 14:12:11,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689775931694 (current time:1689775931694). 2023-07-19 14:12:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 14:12:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x78b61c3e to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:11,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2803f6e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:11,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:11,708 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:11,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78b61c3e to 127.0.0.1:58621 2023-07-19 14:12:11,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:11,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(139): Connect 0x35d6ebc9 to 127.0.0.1:58621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 14:12:11,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d4946a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 14:12:11,724 DEBUG [hconnection-0x4a4a4b56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:11,728 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:11,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 14:12:11,736 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 14:12:11,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35d6ebc9 to 127.0.0.1:58621 2023-07-19 14:12:11,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:11,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 14:12:11,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 14:12:11,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:11,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:11,744 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:11,745 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689776531745 2023-07-19 14:12:11,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 14:12:11,746 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 14:12:11,746 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 14:12:11,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,748 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 14:12:11,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:11,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 14:12:11,752 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:11,754 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689776531754 2023-07-19 14:12:11,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,799 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 14:12:11,799 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,800 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 14:12:11,800 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 14:12:11,801 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,801 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,802 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,802 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,803 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,802 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,803 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,803 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,804 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,804 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 14:12:11,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 14:12:11,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 14:12:11,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,806 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:11,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34059,1689775817131' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,807 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 14:12:11,809 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:11,809 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:11,809 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:11,809 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 14:12:11,811 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 14:12:11,811 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 14:12:11,811 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 14:12:11,812 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,814 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,814 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,815 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,814 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,815 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,815 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,815 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,815 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,815 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 14:12:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41889,1689775817007' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e9d25d6[Count = 1] remaining members to acquire global barrier 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36051,1689775817079' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 14:12:11,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e9d25d6[Count = 0] remaining members to acquire global barrier 2023-07-19 14:12:11,822 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 14:12:11,822 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,827 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,828 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:11,828 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:11,828 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34059,1689775817131' in zk 2023-07-19 14:12:11,828 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:11,828 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 14:12:11,829 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:11,829 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,830 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 14:12:11,830 DEBUG [member: 'jenkins-hbase4.apache.org,34059,1689775817131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:11,831 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:11,832 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:11,831 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 14:12:11,832 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 14:12:11,832 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:11,832 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:11,832 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. started... 2023-07-19 14:12:11,832 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. started... 2023-07-19 14:12:11,832 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ef9a53d48fe7b383cf81e90f875d1ee6 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 14:12:11,832 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 592c35859d3bc6a3c4163fa08e139719 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 14:12:11,844 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/.tmp/cf/34e3111f08d64ed989886976821bda42 2023-07-19 14:12:11,846 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:11,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:11,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 14:12:11,852 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/.tmp/cf/0a150d4ccfed4b43b5ac0953c335ddb5 2023-07-19 14:12:11,856 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/.tmp/cf/34e3111f08d64ed989886976821bda42 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf/34e3111f08d64ed989886976821bda42 2023-07-19 14:12:11,858 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 14:12:11,863 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/.tmp/cf/0a150d4ccfed4b43b5ac0953c335ddb5 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf/0a150d4ccfed4b43b5ac0953c335ddb5 2023-07-19 14:12:11,864 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf/34e3111f08d64ed989886976821bda42, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 14:12:11,865 INFO [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ef9a53d48fe7b383cf81e90f875d1ee6 in 33ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:11,865 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 14:12:11,865 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef9a53d48fe7b383cf81e90f875d1ee6: 2023-07-19 14:12:11,865 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,865 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:11,866 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf/34e3111f08d64ed989886976821bda42] hfiles 2023-07-19 14:12:11,866 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf/34e3111f08d64ed989886976821bda42 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,876 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf/0a150d4ccfed4b43b5ac0953c335ddb5, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 14:12:11,879 INFO [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 592c35859d3bc6a3c4163fa08e139719 in 47ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:11,900 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 592c35859d3bc6a3c4163fa08e139719: 2023-07-19 14:12:11,900 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,900 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 14:12:11,901 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf/0a150d4ccfed4b43b5ac0953c335ddb5] hfiles 2023-07-19 14:12:11,901 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf/0a150d4ccfed4b43b5ac0953c335ddb5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,916 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. completed. 2023-07-19 14:12:11,916 DEBUG [rs(jenkins-hbase4.apache.org,41889,1689775817007)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41889,1689775817007' in zk 2023-07-19 14:12:11,916 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. completed. 2023-07-19 14:12:11,917 DEBUG [rs(jenkins-hbase4.apache.org,36051,1689775817079)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 14:12:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 14:12:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 14:12:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36051,1689775817079' in zk 2023-07-19 14:12:11,918 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,41889,1689775817007' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:11,920 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 14:12:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,920 DEBUG [member: 'jenkins-hbase4.apache.org,36051,1689775817079' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 14:12:11,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41889,1689775817007': 2023-07-19 14:12:11,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41889,1689775817007' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 14:12:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36051,1689775817079': 2023-07-19 14:12:11,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36051,1689775817079' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 14:12:11,933 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 14:12:11,933 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 14:12:11,933 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 14:12:11,933 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,933 INFO [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 14:12:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,935 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,936 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 14:12:11,937 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,938 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 14:12:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,940 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 14:12:11,941 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,941 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,946 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,946 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,946 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,946 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 14:12:11,946 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,946 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 14:12:11,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 14:12:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 14:12:11,947 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,947 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,947 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,947 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,948 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,949 DEBUG [(jenkins-hbase4.apache.org,35343,1689775815498)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 14:12:11,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 14:12:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 14:12:11,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 14:12:11,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,992 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:11,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689775931746Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689775931951 (+205 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689775931951Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689775931960 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689775931970 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689775931991 (+21 ms) 2023-07-19 14:12:11,995 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 14:12:11,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 248 msec 2023-07-19 14:12:12,059 DEBUG [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 14:12:12,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 14:12:12,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 14:12:12,060 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060 2023-07-19 14:12:12,060 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35063, tgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060, rawTgtDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060, srcFsUri=hdfs://localhost:35063, srcDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:12:12,083 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81 2023-07-19 14:12:12,083 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1824069885_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:12,083 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35063, inputRoot=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81, snapshotDir=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 14:12:12,094 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:12,118 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,118 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,119 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,119 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,120 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,120 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,120 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,189 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/hadoop-3745950049178826777.jar 2023-07-19 14:12:12,190 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,190 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,190 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,191 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,191 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,191 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 14:12:12,192 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 14:12:12,192 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 14:12:12,192 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 14:12:12,193 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 14:12:12,193 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 14:12:12,193 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 14:12:12,194 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 14:12:12,194 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 14:12:12,194 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 14:12:12,195 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 14:12:12,195 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:12,195 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:12,196 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:12,196 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:12,196 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 14:12:12,196 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:12,197 DEBUG [Listener at jenkins-hbase4.apache.org/45907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 14:12:12,700 WARN [Listener at jenkins-hbase4.apache.org/45907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 14:12:12,702 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 14:12:12,705 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 14:12:13,326 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:12:13,326 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 14:12:13,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0006_000001 (auth:SIMPLE) 2023-07-19 14:12:13,719 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:15,008 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:12:19,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:21,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:26,315 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:27,930 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 14:12:27,931 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 14:12:27,944 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:27,944 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 14:12:27,944 INFO [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 14:12:27,944 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 14:12:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 14:12:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2042195013_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 14:12:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/45907] snapshot.TestExportSnapshot(367): hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/export-test/export-1689775932060/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 14:12:27,952 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:27,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:27,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:27,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 14:12:27,957 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775947956"}]},"ts":"1689775947956"} 2023-07-19 14:12:27,958 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 14:12:27,959 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 14:12:27,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, UNASSIGN}] 2023-07-19 14:12:27,962 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, UNASSIGN 2023-07-19 14:12:27,962 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, UNASSIGN 2023-07-19 14:12:27,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ef9a53d48fe7b383cf81e90f875d1ee6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:27,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775947963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775947963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775947963"}]},"ts":"1689775947963"} 2023-07-19 14:12:27,963 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=592c35859d3bc6a3c4163fa08e139719, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:27,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775947963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689775947963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689775947963"}]},"ts":"1689775947963"} 2023-07-19 14:12:27,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ef9a53d48fe7b383cf81e90f875d1ee6, server=jenkins-hbase4.apache.org,41889,1689775817007}] 2023-07-19 14:12:27,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 592c35859d3bc6a3c4163fa08e139719, server=jenkins-hbase4.apache.org,36051,1689775817079}] 2023-07-19 14:12:28,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 14:12:28,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:28,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:28,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 592c35859d3bc6a3c4163fa08e139719, disabling compactions & flushes 2023-07-19 14:12:28,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef9a53d48fe7b383cf81e90f875d1ee6, disabling compactions & flushes 2023-07-19 14:12:28,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:28,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:28,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:28,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:28,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. after waiting 0 ms 2023-07-19 14:12:28,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:28,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. after waiting 0 ms 2023-07-19 14:12:28,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:28,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:28,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:28,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719. 2023-07-19 14:12:28,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 592c35859d3bc6a3c4163fa08e139719: 2023-07-19 14:12:28,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6. 2023-07-19 14:12:28,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef9a53d48fe7b383cf81e90f875d1ee6: 2023-07-19 14:12:28,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:28,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=592c35859d3bc6a3c4163fa08e139719, regionState=CLOSED 2023-07-19 14:12:28,133 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775948133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775948133"}]},"ts":"1689775948133"} 2023-07-19 14:12:28,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:28,136 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ef9a53d48fe7b383cf81e90f875d1ee6, regionState=CLOSED 2023-07-19 14:12:28,136 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689775948136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689775948136"}]},"ts":"1689775948136"} 2023-07-19 14:12:28,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 14:12:28,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 592c35859d3bc6a3c4163fa08e139719, server=jenkins-hbase4.apache.org,36051,1689775817079 in 172 msec 2023-07-19 14:12:28,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 14:12:28,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ef9a53d48fe7b383cf81e90f875d1ee6, server=jenkins-hbase4.apache.org,41889,1689775817007 in 173 msec 2023-07-19 14:12:28,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=592c35859d3bc6a3c4163fa08e139719, UNASSIGN in 188 msec 2023-07-19 14:12:28,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 14:12:28,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef9a53d48fe7b383cf81e90f875d1ee6, UNASSIGN in 195 msec 2023-07-19 14:12:28,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689775948157"}]},"ts":"1689775948157"} 2023-07-19 14:12:28,160 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 14:12:28,161 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 14:12:28,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 211 msec 2023-07-19 14:12:28,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 14:12:28,259 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 14:12:28,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,263 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,264 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,265 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36051] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,268 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,268 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,268 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,268 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:28,271 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,271 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:28,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:28,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:28,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 14:12:28,273 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:28,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-19 14:12:28,273 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 14:12:28,273 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,273 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:28,273 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,273 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:28,273 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,274 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 14:12:28,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 14:12:28,276 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/recovered.edits] 2023-07-19 14:12:28,280 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf/34e3111f08d64ed989886976821bda42 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/cf/34e3111f08d64ed989886976821bda42 2023-07-19 14:12:28,282 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf, FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/recovered.edits] 2023-07-19 14:12:28,285 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6/recovered.edits/9.seqid 2023-07-19 14:12:28,285 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef9a53d48fe7b383cf81e90f875d1ee6 2023-07-19 14:12:28,289 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf/0a150d4ccfed4b43b5ac0953c335ddb5 to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/cf/0a150d4ccfed4b43b5ac0953c335ddb5 2023-07-19 14:12:28,293 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/recovered.edits/9.seqid to hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719/recovered.edits/9.seqid 2023-07-19 14:12:28,294 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/592c35859d3bc6a3c4163fa08e139719 2023-07-19 14:12:28,294 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 14:12:28,296 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,300 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 14:12:28,311 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 14:12:28,313 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,313 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 14:12:28,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775948313"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:28,313 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689775948313"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:28,324 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 14:12:28,325 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ef9a53d48fe7b383cf81e90f875d1ee6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689775929884.ef9a53d48fe7b383cf81e90f875d1ee6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 592c35859d3bc6a3c4163fa08e139719, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689775929884.592c35859d3bc6a3c4163fa08e139719.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 14:12:28,325 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 14:12:28,325 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689775948325"}]},"ts":"9223372036854775807"} 2023-07-19 14:12:28,326 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 14:12:28,328 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 68 msec 2023-07-19 14:12:28,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 14:12:28,377 INFO [Listener at jenkins-hbase4.apache.org/45907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 14:12:28,387 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 14:12:28,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 14:12:28,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 14:12:28,455 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 763) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-738956539_1 at /127.0.0.1:44044 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1910741519_17 at /127.0.0.1:44058 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:59304 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-738956539_1 at /127.0.0.1:59286 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5202 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (130951516) connection to jenkins-hbase4.apache.org/172.31.14.131:41811 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2042195013_17 at /127.0.0.1:50172 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7c5859e3-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=625 (was 585) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1168 (was 1580) 2023-07-19 14:12:28,455 WARN [Listener at jenkins-hbase4.apache.org/45907] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-19 14:12:28,455 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 14:12:28,464 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:12:32,582 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689775825603_0007_000001 (auth:SIMPLE) 2023-07-19 14:12:33,721 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 14:12:42,583 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:12:56,697 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 14:12:56,698 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:12:56,804 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 14:12:56,812 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 14:12:56,813 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 14:12:56,829 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 14:12:56,933 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 14:12:56,933 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 14:12:56,933 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 14:12:56,934 INFO [Listener at jenkins-hbase4.apache.org/45907] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 14:12:56,934 DEBUG [Listener at jenkins-hbase4.apache.org/45907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d66cb3d to 127.0.0.1:58621 2023-07-19 14:12:56,934 DEBUG [Listener at jenkins-hbase4.apache.org/45907] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:56,934 DEBUG [Listener at jenkins-hbase4.apache.org/45907] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 14:12:56,934 DEBUG [Listener at jenkins-hbase4.apache.org/45907] util.JVMClusterUtil(257): Found active master hash=575097186, stopped=false 2023-07-19 14:12:56,934 DEBUG [Listener at jenkins-hbase4.apache.org/45907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:56,934 DEBUG [Listener at jenkins-hbase4.apache.org/45907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 14:12:56,935 INFO [Listener at jenkins-hbase4.apache.org/45907] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:12:56,937 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:12:56,937 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:12:56,937 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:12:56,937 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 14:12:56,937 INFO [Listener at jenkins-hbase4.apache.org/45907] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 14:12:56,937 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 14:12:56,938 DEBUG [Listener at jenkins-hbase4.apache.org/45907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3be21830 to 127.0.0.1:58621 2023-07-19 14:12:56,938 DEBUG [Listener at jenkins-hbase4.apache.org/45907] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:56,938 INFO [Listener at jenkins-hbase4.apache.org/45907] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41889,1689775817007' ***** 2023-07-19 14:12:56,938 DEBUG [Listener at jenkins-hbase4.apache.org/45907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:56,938 INFO [Listener at jenkins-hbase4.apache.org/45907] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 14:12:56,938 INFO [Listener at jenkins-hbase4.apache.org/45907] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36051,1689775817079' ***** 2023-07-19 14:12:56,938 DEBUG [Listener at jenkins-hbase4.apache.org/45907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:56,939 INFO [Listener at jenkins-hbase4.apache.org/45907] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 14:12:56,939 INFO [Listener at jenkins-hbase4.apache.org/45907] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34059,1689775817131' ***** 2023-07-19 14:12:56,939 DEBUG [Listener at jenkins-hbase4.apache.org/45907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:56,939 INFO [Listener at jenkins-hbase4.apache.org/45907] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 14:12:56,939 INFO [RS:1;jenkins-hbase4:36051] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 14:12:56,939 INFO [RS:0;jenkins-hbase4:41889] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 14:12:56,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:12:56,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:12:56,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:12:56,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 14:12:56,943 INFO [RS:2;jenkins-hbase4:34059] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 14:12:56,949 INFO [RS:0;jenkins-hbase4:41889] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 14:12:56,950 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 14:12:56,950 INFO [RS:2;jenkins-hbase4:34059] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 14:12:56,950 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 14:12:56,950 INFO [RS:0;jenkins-hbase4:41889] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 14:12:56,950 INFO [RS:1;jenkins-hbase4:36051] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 14:12:56,950 INFO [RS:2;jenkins-hbase4:34059] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 14:12:56,950 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 14:12:56,950 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:56,950 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(3305): Received CLOSE for d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:12:56,950 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:56,951 DEBUG [RS:0;jenkins-hbase4:41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fd3f98c to 127.0.0.1:58621 2023-07-19 14:12:56,951 DEBUG [RS:0;jenkins-hbase4:41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:56,950 DEBUG [RS:2;jenkins-hbase4:34059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46a56610 to 127.0.0.1:58621 2023-07-19 14:12:56,950 INFO [RS:1;jenkins-hbase4:36051] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 14:12:56,954 DEBUG [RS:2;jenkins-hbase4:34059] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:56,954 INFO [RS:0;jenkins-hbase4:41889] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 14:12:56,955 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34059,1689775817131; all regions closed. 2023-07-19 14:12:56,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9f9d7126a3a0efc50c94eb31c601b1f, disabling compactions & flushes 2023-07-19 14:12:56,955 INFO [RS:0;jenkins-hbase4:41889] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 14:12:56,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:12:56,955 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(3305): Received CLOSE for 435f3294234ae2acd05812673d039929 2023-07-19 14:12:56,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:12:56,955 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:56,955 INFO [RS:0;jenkins-hbase4:41889] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 14:12:56,955 DEBUG [RS:1;jenkins-hbase4:36051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2364e6c3 to 127.0.0.1:58621 2023-07-19 14:12:56,955 DEBUG [RS:1;jenkins-hbase4:36051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:56,955 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 14:12:56,956 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 14:12:56,956 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1478): Online Regions={435f3294234ae2acd05812673d039929=hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929.} 2023-07-19 14:12:56,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. after waiting 0 ms 2023-07-19 14:12:56,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 435f3294234ae2acd05812673d039929, disabling compactions & flushes 2023-07-19 14:12:56,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:12:56,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d9f9d7126a3a0efc50c94eb31c601b1f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 14:12:56,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:12:56,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:12:56,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. after waiting 0 ms 2023-07-19 14:12:56,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:12:56,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 435f3294234ae2acd05812673d039929 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 14:12:56,957 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1504): Waiting on 435f3294234ae2acd05812673d039929 2023-07-19 14:12:56,963 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 14:12:56,963 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, d9f9d7126a3a0efc50c94eb31c601b1f=hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f.} 2023-07-19 14:12:56,964 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1504): Waiting on 1588230740, d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:12:56,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 14:12:56,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 14:12:56,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 14:12:56,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 14:12:56,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 14:12:56,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 14:12:57,002 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:12:57,003 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:12:57,005 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:12:57,024 DEBUG [RS:2;jenkins-hbase4:34059] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs 2023-07-19 14:12:57,024 INFO [RS:2;jenkins-hbase4:34059] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34059%2C1689775817131:(num 1689775819756) 2023-07-19 14:12:57,024 DEBUG [RS:2;jenkins-hbase4:34059] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:57,024 INFO [RS:2;jenkins-hbase4:34059] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:12:57,051 INFO [RS:2;jenkins-hbase4:34059] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 14:12:57,051 INFO [RS:2;jenkins-hbase4:34059] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 14:12:57,051 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:12:57,051 INFO [RS:2;jenkins-hbase4:34059] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 14:12:57,052 INFO [RS:2;jenkins-hbase4:34059] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 14:12:57,060 INFO [RS:2;jenkins-hbase4:34059] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34059 2023-07-19 14:12:57,073 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:57,073 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:57,074 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:12:57,073 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:12:57,074 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34059,1689775817131 2023-07-19 14:12:57,073 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:12:57,074 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:12:57,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/.tmp/l/6217389a5c9c4c3988e1e9330f95391c 2023-07-19 14:12:57,075 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34059,1689775817131] 2023-07-19 14:12:57,076 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34059,1689775817131; numProcessing=1 2023-07-19 14:12:57,086 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34059,1689775817131 already deleted, retry=false 2023-07-19 14:12:57,086 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34059,1689775817131 expired; onlineServers=2 2023-07-19 14:12:57,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/.tmp/info/b447d86528a14afe8cdc866023984f81 2023-07-19 14:12:57,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/.tmp/info/600af88367534c73a155ba612a554593 2023-07-19 14:12:57,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6217389a5c9c4c3988e1e9330f95391c 2023-07-19 14:12:57,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/.tmp/l/6217389a5c9c4c3988e1e9330f95391c as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/l/6217389a5c9c4c3988e1e9330f95391c 2023-07-19 14:12:57,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/.tmp/info/600af88367534c73a155ba612a554593 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/info/600af88367534c73a155ba612a554593 2023-07-19 14:12:57,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6217389a5c9c4c3988e1e9330f95391c 2023-07-19 14:12:57,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/l/6217389a5c9c4c3988e1e9330f95391c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 14:12:57,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/info/600af88367534c73a155ba612a554593, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 14:12:57,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b447d86528a14afe8cdc866023984f81 2023-07-19 14:12:57,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d9f9d7126a3a0efc50c94eb31c601b1f in 189ms, sequenceid=6, compaction requested=false 2023-07-19 14:12:57,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 435f3294234ae2acd05812673d039929 in 188ms, sequenceid=18, compaction requested=false 2023-07-19 14:12:57,158 DEBUG [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1504): Waiting on 435f3294234ae2acd05812673d039929 2023-07-19 14:12:57,164 DEBUG [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1504): Waiting on 1588230740, d9f9d7126a3a0efc50c94eb31c601b1f 2023-07-19 14:12:57,195 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,195 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:34059-0x1017deb3a8b0003, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,195 INFO [RS:2;jenkins-hbase4:34059] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34059,1689775817131; zookeeper connection closed. 2023-07-19 14:12:57,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/acl/435f3294234ae2acd05812673d039929/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 14:12:57,199 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1414add4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1414add4 2023-07-19 14:12:57,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/namespace/d9f9d7126a3a0efc50c94eb31c601b1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 14:12:57,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:57,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:12:57,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 435f3294234ae2acd05812673d039929: 2023-07-19 14:12:57,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689775821204.435f3294234ae2acd05812673d039929. 2023-07-19 14:12:57,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:57,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:12:57,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9f9d7126a3a0efc50c94eb31c601b1f: 2023-07-19 14:12:57,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689775820316.d9f9d7126a3a0efc50c94eb31c601b1f. 2023-07-19 14:12:57,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/.tmp/rep_barrier/6c48d7956baf4e779624dcd9b53d1c9d 2023-07-19 14:12:57,224 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c48d7956baf4e779624dcd9b53d1c9d 2023-07-19 14:12:57,258 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/.tmp/table/ebabbc7ff9f647bfa409672122ab105d 2023-07-19 14:12:57,263 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebabbc7ff9f647bfa409672122ab105d 2023-07-19 14:12:57,264 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/.tmp/info/b447d86528a14afe8cdc866023984f81 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/info/b447d86528a14afe8cdc866023984f81 2023-07-19 14:12:57,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b447d86528a14afe8cdc866023984f81 2023-07-19 14:12:57,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/info/b447d86528a14afe8cdc866023984f81, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 14:12:57,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/.tmp/rep_barrier/6c48d7956baf4e779624dcd9b53d1c9d as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/rep_barrier/6c48d7956baf4e779624dcd9b53d1c9d 2023-07-19 14:12:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c48d7956baf4e779624dcd9b53d1c9d 2023-07-19 14:12:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/rep_barrier/6c48d7956baf4e779624dcd9b53d1c9d, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 14:12:57,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/.tmp/table/ebabbc7ff9f647bfa409672122ab105d as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/table/ebabbc7ff9f647bfa409672122ab105d 2023-07-19 14:12:57,281 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebabbc7ff9f647bfa409672122ab105d 2023-07-19 14:12:57,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/table/ebabbc7ff9f647bfa409672122ab105d, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 14:12:57,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 317ms, sequenceid=131, compaction requested=false 2023-07-19 14:12:57,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 14:12:57,326 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 14:12:57,326 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 14:12:57,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 14:12:57,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 14:12:57,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 14:12:57,358 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36051,1689775817079; all regions closed. 2023-07-19 14:12:57,364 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41889,1689775817007; all regions closed. 2023-07-19 14:12:57,376 DEBUG [RS:1;jenkins-hbase4:36051] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs 2023-07-19 14:12:57,376 INFO [RS:1;jenkins-hbase4:36051] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36051%2C1689775817079:(num 1689775819759) 2023-07-19 14:12:57,376 DEBUG [RS:1;jenkins-hbase4:36051] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:57,376 INFO [RS:1;jenkins-hbase4:36051] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:12:57,376 INFO [RS:1;jenkins-hbase4:36051] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 14:12:57,377 INFO [RS:1;jenkins-hbase4:36051] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 14:12:57,377 INFO [RS:1;jenkins-hbase4:36051] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 14:12:57,377 INFO [RS:1;jenkins-hbase4:36051] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 14:12:57,378 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:12:57,378 INFO [RS:1;jenkins-hbase4:36051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36051 2023-07-19 14:12:57,380 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:12:57,380 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:57,380 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36051,1689775817079 2023-07-19 14:12:57,381 DEBUG [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs 2023-07-19 14:12:57,381 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36051,1689775817079] 2023-07-19 14:12:57,382 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36051,1689775817079; numProcessing=2 2023-07-19 14:12:57,381 INFO [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41889%2C1689775817007.meta:.meta(num 1689775819699) 2023-07-19 14:12:57,394 DEBUG [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/oldWALs 2023-07-19 14:12:57,395 INFO [RS:0;jenkins-hbase4:41889] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41889%2C1689775817007:(num 1689775819757) 2023-07-19 14:12:57,395 DEBUG [RS:0;jenkins-hbase4:41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:57,395 INFO [RS:0;jenkins-hbase4:41889] regionserver.LeaseManager(133): Closed leases 2023-07-19 14:12:57,395 INFO [RS:0;jenkins-hbase4:41889] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 14:12:57,395 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:12:57,400 INFO [RS:0;jenkins-hbase4:41889] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41889 2023-07-19 14:12:57,482 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,482 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:36051-0x1017deb3a8b0002, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,482 INFO [RS:1;jenkins-hbase4:36051] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36051,1689775817079; zookeeper connection closed. 2023-07-19 14:12:57,482 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@bd7efad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@bd7efad 2023-07-19 14:12:57,486 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41889,1689775817007 2023-07-19 14:12:57,487 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36051,1689775817079 already deleted, retry=false 2023-07-19 14:12:57,487 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 14:12:57,487 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36051,1689775817079 expired; onlineServers=1 2023-07-19 14:12:57,489 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41889,1689775817007] 2023-07-19 14:12:57,489 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41889,1689775817007; numProcessing=3 2023-07-19 14:12:57,490 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41889,1689775817007 already deleted, retry=false 2023-07-19 14:12:57,490 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41889,1689775817007 expired; onlineServers=0 2023-07-19 14:12:57,490 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35343,1689775815498' ***** 2023-07-19 14:12:57,490 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 14:12:57,490 DEBUG [M:0;jenkins-hbase4:35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637a4359, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 14:12:57,490 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35343,1689775815498 2023-07-19 14:12:57,490 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35343,1689775815498; all regions closed. 2023-07-19 14:12:57,490 DEBUG [M:0;jenkins-hbase4:35343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 14:12:57,490 DEBUG [M:0;jenkins-hbase4:35343] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 14:12:57,491 DEBUG [M:0;jenkins-hbase4:35343] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 14:12:57,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689775818826] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689775818826,5,FailOnTimeoutGroup] 2023-07-19 14:12:57,491 INFO [M:0;jenkins-hbase4:35343] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 14:12:57,491 INFO [M:0;jenkins-hbase4:35343] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 14:12:57,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689775818827] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689775818827,5,FailOnTimeoutGroup] 2023-07-19 14:12:57,491 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 14:12:57,491 INFO [M:0;jenkins-hbase4:35343] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 14:12:57,491 DEBUG [M:0;jenkins-hbase4:35343] master.HMaster(1512): Stopping service threads 2023-07-19 14:12:57,491 INFO [M:0;jenkins-hbase4:35343] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 14:12:57,491 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 14:12:57,491 ERROR [M:0;jenkins-hbase4:35343] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-19 14:12:57,492 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 14:12:57,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 14:12:57,492 INFO [M:0;jenkins-hbase4:35343] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 14:12:57,492 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 14:12:57,493 DEBUG [M:0;jenkins-hbase4:35343] zookeeper.ZKUtil(398): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 14:12:57,493 WARN [M:0;jenkins-hbase4:35343] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 14:12:57,493 INFO [M:0;jenkins-hbase4:35343] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 14:12:57,493 INFO [M:0;jenkins-hbase4:35343] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 14:12:57,494 DEBUG [M:0;jenkins-hbase4:35343] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 14:12:57,495 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:12:57,495 DEBUG [M:0;jenkins-hbase4:35343] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:12:57,495 DEBUG [M:0;jenkins-hbase4:35343] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 14:12:57,495 DEBUG [M:0;jenkins-hbase4:35343] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:12:57,495 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.35 KB heapSize=449.59 KB 2023-07-19 14:12:57,545 INFO [M:0;jenkins-hbase4:35343] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.35 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/312834c895e54e4b85f4e5bae57dd3a2 2023-07-19 14:12:57,549 INFO [M:0;jenkins-hbase4:35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 312834c895e54e4b85f4e5bae57dd3a2 2023-07-19 14:12:57,550 DEBUG [M:0;jenkins-hbase4:35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/312834c895e54e4b85f4e5bae57dd3a2 as hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/312834c895e54e4b85f4e5bae57dd3a2 2023-07-19 14:12:57,556 INFO [M:0;jenkins-hbase4:35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 312834c895e54e4b85f4e5bae57dd3a2 2023-07-19 14:12:57,556 INFO [M:0;jenkins-hbase4:35343] regionserver.HStore(1080): Added hdfs://localhost:35063/user/jenkins/test-data/42eca05b-d35e-cba7-0804-82d76d6b9b81/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/312834c895e54e4b85f4e5bae57dd3a2, entries=119, sequenceid=899, filesize=28.5 K 2023-07-19 14:12:57,557 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegion(2948): Finished flush of dataSize ~373.35 KB/382308, heapSize ~449.57 KB/460360, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 62ms, sequenceid=899, compaction requested=false 2023-07-19 14:12:57,568 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 14:12:57,568 DEBUG [M:0;jenkins-hbase4:35343] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 14:12:57,581 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 14:12:57,581 INFO [M:0;jenkins-hbase4:35343] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 14:12:57,582 INFO [M:0;jenkins-hbase4:35343] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35343 2023-07-19 14:12:57,583 DEBUG [M:0;jenkins-hbase4:35343] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35343,1689775815498 already deleted, retry=false 2023-07-19 14:12:57,589 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,589 INFO [RS:0;jenkins-hbase4:41889] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41889,1689775817007; zookeeper connection closed. 2023-07-19 14:12:57,589 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): regionserver:41889-0x1017deb3a8b0001, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,589 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c89c5ec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c89c5ec 2023-07-19 14:12:57,589 INFO [Listener at jenkins-hbase4.apache.org/45907] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 14:12:57,689 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,689 INFO [M:0;jenkins-hbase4:35343] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35343,1689775815498; zookeeper connection closed. 2023-07-19 14:12:57,689 DEBUG [Listener at localhost/33747-EventThread] zookeeper.ZKWatcher(600): master:35343-0x1017deb3a8b0000, quorum=127.0.0.1:58621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 14:12:57,691 WARN [Listener at jenkins-hbase4.apache.org/45907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 14:12:57,696 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:12:57,799 WARN [BP-306757607-172.31.14.131-1689775811453 heartbeating to localhost/127.0.0.1:35063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 14:12:57,799 WARN [BP-306757607-172.31.14.131-1689775811453 heartbeating to localhost/127.0.0.1:35063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-306757607-172.31.14.131-1689775811453 (Datanode Uuid c48d7029-eec5-4db1-8db9-0b85b8f8dea2) service to localhost/127.0.0.1:35063 2023-07-19 14:12:57,801 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data5/current/BP-306757607-172.31.14.131-1689775811453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:12:57,802 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data6/current/BP-306757607-172.31.14.131-1689775811453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:12:57,804 WARN [Listener at jenkins-hbase4.apache.org/45907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 14:12:57,808 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:12:57,911 WARN [BP-306757607-172.31.14.131-1689775811453 heartbeating to localhost/127.0.0.1:35063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 14:12:57,911 WARN [BP-306757607-172.31.14.131-1689775811453 heartbeating to localhost/127.0.0.1:35063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-306757607-172.31.14.131-1689775811453 (Datanode Uuid 6cc33ba1-256b-41f7-a53d-37b340636b21) service to localhost/127.0.0.1:35063 2023-07-19 14:12:57,912 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data3/current/BP-306757607-172.31.14.131-1689775811453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:12:57,912 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data4/current/BP-306757607-172.31.14.131-1689775811453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:12:57,913 WARN [Listener at jenkins-hbase4.apache.org/45907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 14:12:57,919 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:12:58,022 WARN [BP-306757607-172.31.14.131-1689775811453 heartbeating to localhost/127.0.0.1:35063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 14:12:58,022 WARN [BP-306757607-172.31.14.131-1689775811453 heartbeating to localhost/127.0.0.1:35063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-306757607-172.31.14.131-1689775811453 (Datanode Uuid 719159af-9750-47d4-aef9-8711bf05cb6b) service to localhost/127.0.0.1:35063 2023-07-19 14:12:58,022 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data1/current/BP-306757607-172.31.14.131-1689775811453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:12:58,023 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d80de9d2-e6c1-64eb-1330-1e7104f80e27/cluster_b4039193-c035-940b-2b9c-f9a2b61949f0/dfs/data/data2/current/BP-306757607-172.31.14.131-1689775811453] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 14:12:58,046 INFO [Listener at jenkins-hbase4.apache.org/45907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 14:12:58,177 INFO [Listener at jenkins-hbase4.apache.org/45907] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 14:12:58,269 INFO [Listener at jenkins-hbase4.apache.org/45907] hbase.HBaseTestingUtility(1293): Minicluster is down