2023-07-17 21:10:36,098 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 21:10:36,355 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1 2023-07-17 21:10:36,355 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-17 21:10:36,405 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 21:10:36,746 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 21:10:36,747 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e, deleteOnExit=true 2023-07-17 21:10:36,747 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 21:10:36,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/test.cache.data in system properties and HBase conf 2023-07-17 21:10:36,748 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 21:10:36,749 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop.log.dir in system properties and HBase conf 2023-07-17 21:10:36,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 21:10:36,750 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 21:10:36,750 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 21:10:37,150 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 21:10:37,157 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:37,158 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:37,158 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 21:10:37,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:37,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 21:10:37,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 21:10:37,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:37,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:37,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 21:10:37,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/nfs.dump.dir in system properties and HBase conf 2023-07-17 21:10:37,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir in system properties and HBase conf 2023-07-17 21:10:37,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:37,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 21:10:37,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 21:10:37,831 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 21:10:37,838 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 21:10:38,209 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 21:10:38,408 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 21:10:38,427 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:38,472 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:38,513 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_localhost_37437_hdfs____alugym/webapp 2023-07-17 21:10:38,668 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37437 2023-07-17 21:10:38,679 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 21:10:38,680 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 21:10:39,260 WARN [Listener at localhost/38145] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:39,387 WARN [Listener at localhost/38145] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 21:10:39,416 WARN [Listener at localhost/38145] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:39,475 INFO [Listener at localhost/38145] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:39,496 INFO [Listener at localhost/38145] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_localhost_42373_datanode____.218y2w/webapp 2023-07-17 21:10:39,622 INFO [Listener at localhost/38145] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42373 2023-07-17 21:10:40,147 WARN [Listener at localhost/33161] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:40,199 WARN [Listener at localhost/33161] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 21:10:40,215 WARN [Listener at localhost/33161] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:40,217 INFO [Listener at localhost/33161] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:40,230 INFO [Listener at localhost/33161] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_localhost_33203_datanode____qhh30/webapp 2023-07-17 21:10:40,372 INFO [Listener at localhost/33161] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33203 2023-07-17 21:10:40,398 WARN [Listener at localhost/35567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:40,500 WARN [Listener at localhost/35567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 21:10:40,513 WARN [Listener at localhost/35567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:40,517 INFO [Listener at localhost/35567] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:40,530 INFO [Listener at localhost/35567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_localhost_33999_datanode____.4suzk/webapp 2023-07-17 21:10:40,701 INFO [Listener at localhost/35567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33999 2023-07-17 21:10:40,717 WARN [Listener at localhost/38753] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 21:10:41,113 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18f0e5678d9fbf9: Processing first storage report for DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c from datanode 9e7eb5e6-b60b-4ac9-9386-eb6b5b23980d 2023-07-17 21:10:41,115 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18f0e5678d9fbf9: from storage DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c node DatanodeRegistration(127.0.0.1:44689, datanodeUuid=9e7eb5e6-b60b-4ac9-9386-eb6b5b23980d, infoPort=39993, infoSecurePort=0, ipcPort=38753, storageInfo=lv=-57;cid=testClusterID;nsid=724049183;c=1689628237932), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,115 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb823c12f0f98af3d: Processing first storage report for DS-754b6178-07a5-4f9c-8313-0f7dce32a14d from datanode 5545e066-12da-49d5-8ca3-5b06c2e55309 2023-07-17 21:10:41,115 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb823c12f0f98af3d: from storage DS-754b6178-07a5-4f9c-8313-0f7dce32a14d node DatanodeRegistration(127.0.0.1:36325, datanodeUuid=5545e066-12da-49d5-8ca3-5b06c2e55309, infoPort=46793, infoSecurePort=0, ipcPort=33161, storageInfo=lv=-57;cid=testClusterID;nsid=724049183;c=1689628237932), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,115 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d8a0b63e2728407: Processing first storage report for DS-b0f0543a-d594-480b-8826-7e613f381536 from datanode 328abeb5-08dd-46f9-8bf9-d61e15113814 2023-07-17 21:10:41,115 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d8a0b63e2728407: from storage DS-b0f0543a-d594-480b-8826-7e613f381536 node DatanodeRegistration(127.0.0.1:37901, datanodeUuid=328abeb5-08dd-46f9-8bf9-d61e15113814, infoPort=33739, infoSecurePort=0, ipcPort=35567, storageInfo=lv=-57;cid=testClusterID;nsid=724049183;c=1689628237932), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,115 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18f0e5678d9fbf9: Processing first storage report for DS-516d0f62-b8dd-442c-92bc-12e61f19eeed from datanode 9e7eb5e6-b60b-4ac9-9386-eb6b5b23980d 2023-07-17 21:10:41,116 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18f0e5678d9fbf9: from storage DS-516d0f62-b8dd-442c-92bc-12e61f19eeed node DatanodeRegistration(127.0.0.1:44689, datanodeUuid=9e7eb5e6-b60b-4ac9-9386-eb6b5b23980d, infoPort=39993, infoSecurePort=0, ipcPort=38753, storageInfo=lv=-57;cid=testClusterID;nsid=724049183;c=1689628237932), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,116 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb823c12f0f98af3d: Processing first storage report for DS-6ea1a39b-598f-48f0-9c49-8248c65c7a75 from datanode 5545e066-12da-49d5-8ca3-5b06c2e55309 2023-07-17 21:10:41,116 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb823c12f0f98af3d: from storage DS-6ea1a39b-598f-48f0-9c49-8248c65c7a75 node DatanodeRegistration(127.0.0.1:36325, datanodeUuid=5545e066-12da-49d5-8ca3-5b06c2e55309, infoPort=46793, infoSecurePort=0, ipcPort=33161, storageInfo=lv=-57;cid=testClusterID;nsid=724049183;c=1689628237932), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,116 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d8a0b63e2728407: Processing first storage report for DS-8c82e716-178b-4400-84c7-7818cdb85fb7 from datanode 328abeb5-08dd-46f9-8bf9-d61e15113814 2023-07-17 21:10:41,116 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d8a0b63e2728407: from storage DS-8c82e716-178b-4400-84c7-7818cdb85fb7 node DatanodeRegistration(127.0.0.1:37901, datanodeUuid=328abeb5-08dd-46f9-8bf9-d61e15113814, infoPort=33739, infoSecurePort=0, ipcPort=35567, storageInfo=lv=-57;cid=testClusterID;nsid=724049183;c=1689628237932), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 21:10:41,361 DEBUG [Listener at localhost/38753] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1 2023-07-17 21:10:41,458 INFO [Listener at localhost/38753] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/zookeeper_0, clientPort=53065, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 21:10:41,484 INFO [Listener at localhost/38753] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53065 2023-07-17 21:10:41,496 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:41,499 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:42,236 INFO [Listener at localhost/38753] util.FSUtils(471): Created version file at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 with version=8 2023-07-17 21:10:42,236 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/hbase-staging 2023-07-17 21:10:42,614 INFO [Listener at localhost/38753] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 21:10:43,264 INFO [Listener at localhost/38753] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:43,299 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:43,300 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:43,300 INFO [Listener at localhost/38753] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:43,300 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:43,300 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:43,459 INFO [Listener at localhost/38753] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:43,553 DEBUG [Listener at localhost/38753] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 21:10:43,660 INFO [Listener at localhost/38753] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38665 2023-07-17 21:10:43,673 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:43,675 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:43,699 INFO [Listener at localhost/38753] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38665 connecting to ZooKeeper ensemble=127.0.0.1:53065 2023-07-17 21:10:43,778 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:386650x0, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:43,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38665-0x101751f711f0000 connected 2023-07-17 21:10:43,881 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:43,882 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:43,896 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:43,909 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38665 2023-07-17 21:10:43,910 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38665 2023-07-17 21:10:43,911 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38665 2023-07-17 21:10:43,913 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38665 2023-07-17 21:10:43,914 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38665 2023-07-17 21:10:43,921 INFO [Listener at localhost/38753] master.HMaster(444): hbase.rootdir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, hbase.cluster.distributed=false 2023-07-17 21:10:44,019 INFO [Listener at localhost/38753] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:44,019 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,020 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,020 INFO [Listener at localhost/38753] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:44,020 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,020 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:44,028 INFO [Listener at localhost/38753] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:44,036 INFO [Listener at localhost/38753] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42831 2023-07-17 21:10:44,040 INFO [Listener at localhost/38753] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 21:10:44,055 DEBUG [Listener at localhost/38753] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 21:10:44,056 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,058 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,061 INFO [Listener at localhost/38753] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42831 connecting to ZooKeeper ensemble=127.0.0.1:53065 2023-07-17 21:10:44,076 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:428310x0, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:44,077 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:428310x0, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:44,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42831-0x101751f711f0001 connected 2023-07-17 21:10:44,079 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:44,080 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:44,087 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42831 2023-07-17 21:10:44,088 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42831 2023-07-17 21:10:44,090 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42831 2023-07-17 21:10:44,090 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42831 2023-07-17 21:10:44,090 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42831 2023-07-17 21:10:44,104 INFO [Listener at localhost/38753] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:44,105 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,105 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,106 INFO [Listener at localhost/38753] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:44,106 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,106 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:44,106 INFO [Listener at localhost/38753] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:44,111 INFO [Listener at localhost/38753] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34535 2023-07-17 21:10:44,112 INFO [Listener at localhost/38753] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 21:10:44,114 DEBUG [Listener at localhost/38753] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 21:10:44,116 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,119 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,124 INFO [Listener at localhost/38753] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34535 connecting to ZooKeeper ensemble=127.0.0.1:53065 2023-07-17 21:10:44,127 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:345350x0, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:44,128 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:345350x0, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:44,129 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:345350x0, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:44,130 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:345350x0, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:44,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34535-0x101751f711f0002 connected 2023-07-17 21:10:44,134 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34535 2023-07-17 21:10:44,138 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34535 2023-07-17 21:10:44,138 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34535 2023-07-17 21:10:44,140 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34535 2023-07-17 21:10:44,141 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34535 2023-07-17 21:10:44,153 INFO [Listener at localhost/38753] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 21:10:44,153 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,153 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,154 INFO [Listener at localhost/38753] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 21:10:44,154 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 21:10:44,154 INFO [Listener at localhost/38753] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 21:10:44,154 INFO [Listener at localhost/38753] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 21:10:44,156 INFO [Listener at localhost/38753] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36811 2023-07-17 21:10:44,157 INFO [Listener at localhost/38753] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 21:10:44,158 DEBUG [Listener at localhost/38753] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 21:10:44,159 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,161 INFO [Listener at localhost/38753] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,164 INFO [Listener at localhost/38753] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36811 connecting to ZooKeeper ensemble=127.0.0.1:53065 2023-07-17 21:10:44,177 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:368110x0, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 21:10:44,178 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:368110x0, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:10:44,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36811-0x101751f711f0003 connected 2023-07-17 21:10:44,180 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:10:44,181 DEBUG [Listener at localhost/38753] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 21:10:44,185 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36811 2023-07-17 21:10:44,186 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36811 2023-07-17 21:10:44,187 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36811 2023-07-17 21:10:44,190 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36811 2023-07-17 21:10:44,190 DEBUG [Listener at localhost/38753] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36811 2023-07-17 21:10:44,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:44,201 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 21:10:44,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:44,224 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,224 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,224 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,224 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 21:10:44,224 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:44,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 21:10:44,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 21:10:44,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38665,1689628242426 from backup master directory 2023-07-17 21:10:44,233 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:44,233 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 21:10:44,234 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:44,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:44,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 21:10:44,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 21:10:44,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/hbase.id with ID: bbcb17cf-cf81-4971-a313-5059c45e9dbe 2023-07-17 21:10:44,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 21:10:44,442 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:44,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7f0afdd0 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:44,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e1a89d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:44,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:44,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 21:10:44,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 21:10:44,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 21:10:44,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 21:10:44,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 21:10:44,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:44,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store-tmp 2023-07-17 21:10:44,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:44,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 21:10:44,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 21:10:44,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:10:44,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 21:10:44,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/WALs/jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:44,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38665%2C1689628242426, suffix=, logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/WALs/jenkins-hbase4.apache.org,38665,1689628242426, archiveDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/oldWALs, maxLogs=10 2023-07-17 21:10:44,870 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK] 2023-07-17 21:10:44,873 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK] 2023-07-17 21:10:44,870 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK] 2023-07-17 21:10:44,882 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 21:10:44,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/WALs/jenkins-hbase4.apache.org,38665,1689628242426/jenkins-hbase4.apache.org%2C38665%2C1689628242426.1689628244810 2023-07-17 21:10:44,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK], DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK], DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK]] 2023-07-17 21:10:44,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:44,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:44,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:44,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,094 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,105 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 21:10:45,136 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 21:10:45,150 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:45,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,159 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 21:10:45,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:45,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70282564, jitterRate=0.04729181528091431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:45,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 21:10:45,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 21:10:45,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 21:10:45,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 21:10:45,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 21:10:45,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 21:10:45,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-17 21:10:45,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 21:10:45,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 21:10:45,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 21:10:45,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 21:10:45,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 21:10:45,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 21:10:45,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 21:10:45,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 21:10:45,350 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 21:10:45,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 21:10:45,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 21:10:45,375 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,376 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,376 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,376 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,378 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 21:10:45,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38665,1689628242426, sessionid=0x101751f711f0000, setting cluster-up flag (Was=false) 2023-07-17 21:10:45,397 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 21:10:45,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:45,417 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:45,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 21:10:45,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:45,429 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp 2023-07-17 21:10:45,496 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(951): ClusterId : bbcb17cf-cf81-4971-a313-5059c45e9dbe 2023-07-17 21:10:45,496 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(951): ClusterId : bbcb17cf-cf81-4971-a313-5059c45e9dbe 2023-07-17 21:10:45,503 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(951): ClusterId : bbcb17cf-cf81-4971-a313-5059c45e9dbe 2023-07-17 21:10:45,505 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 21:10:45,515 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 21:10:45,515 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 21:10:45,522 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 21:10:45,529 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 21:10:45,533 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 21:10:45,533 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 21:10:45,533 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 21:10:45,535 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 21:10:45,536 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 21:10:45,537 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 21:10:45,537 DEBUG [RS:1;jenkins-hbase4:34535] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddad224 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:45,538 DEBUG [RS:0;jenkins-hbase4:42831] zookeeper.ReadOnlyZKClient(139): Connect 0x53233c4f to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:45,542 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 21:10:45,552 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ReadOnlyZKClient(139): Connect 0x747d6ee4 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:45,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 21:10:45,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 21:10:45,595 DEBUG [RS:0;jenkins-hbase4:42831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5de4c85b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:45,596 DEBUG [RS:0;jenkins-hbase4:42831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59db573f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:10:45,597 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aba9e1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:45,598 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e850594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:10:45,613 DEBUG [RS:1;jenkins-hbase4:34535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731d33ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:45,614 DEBUG [RS:1;jenkins-hbase4:34535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322039d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:10:45,643 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36811 2023-07-17 21:10:45,646 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42831 2023-07-17 21:10:45,647 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34535 2023-07-17 21:10:45,651 INFO [RS:2;jenkins-hbase4:36811] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 21:10:45,651 INFO [RS:0;jenkins-hbase4:42831] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 21:10:45,652 INFO [RS:0;jenkins-hbase4:42831] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 21:10:45,653 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 21:10:45,651 INFO [RS:1;jenkins-hbase4:34535] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 21:10:45,655 INFO [RS:1;jenkins-hbase4:34535] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 21:10:45,652 INFO [RS:2;jenkins-hbase4:36811] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 21:10:45,655 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 21:10:45,655 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 21:10:45,655 INFO [RS:1;jenkins-hbase4:34535] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,655 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 21:10:45,654 INFO [RS:0;jenkins-hbase4:42831] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,655 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 21:10:45,655 INFO [RS:2;jenkins-hbase4:36811] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:45,658 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 21:10:45,659 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38665,1689628242426 with isa=jenkins-hbase4.apache.org/172.31.14.131:34535, startcode=1689628244104 2023-07-17 21:10:45,659 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38665,1689628242426 with isa=jenkins-hbase4.apache.org/172.31.14.131:36811, startcode=1689628244152 2023-07-17 21:10:45,659 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38665,1689628242426 with isa=jenkins-hbase4.apache.org/172.31.14.131:42831, startcode=1689628244018 2023-07-17 21:10:45,682 DEBUG [RS:1;jenkins-hbase4:34535] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 21:10:45,682 DEBUG [RS:2;jenkins-hbase4:36811] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 21:10:45,684 DEBUG [RS:0;jenkins-hbase4:42831] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 21:10:45,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 21:10:45,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 21:10:45,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 21:10:45,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:45,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:45,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:45,789 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36755, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 21:10:45,789 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33205, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 21:10:45,789 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46987, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 21:10:45,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689628275792 2023-07-17 21:10:45,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 21:10:45,801 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38665] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 21:10:45,806 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 21:10:45,806 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 21:10:45,810 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38665] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 21:10:45,814 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38665] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 21:10:45,817 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:45,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 21:10:45,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 21:10:45,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 21:10:45,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 21:10:45,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 21:10:45,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 21:10:45,848 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 21:10:45,849 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 21:10:45,849 WARN [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 21:10:45,848 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 21:10:45,850 WARN [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 21:10:45,849 WARN [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 21:10:45,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 21:10:45,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 21:10:45,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 21:10:45,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 21:10:45,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689628245858,5,FailOnTimeoutGroup] 2023-07-17 21:10:45,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689628245859,5,FailOnTimeoutGroup] 2023-07-17 21:10:45,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 21:10:45,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:45,903 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:45,904 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:45,904 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:10:45,943 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:45,946 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 21:10:45,950 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/info 2023-07-17 21:10:45,952 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38665,1689628242426 with isa=jenkins-hbase4.apache.org/172.31.14.131:42831, startcode=1689628244018 2023-07-17 21:10:45,952 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 21:10:45,952 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38665,1689628242426 with isa=jenkins-hbase4.apache.org/172.31.14.131:34535, startcode=1689628244104 2023-07-17 21:10:45,952 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38665,1689628242426 with isa=jenkins-hbase4.apache.org/172.31.14.131:36811, startcode=1689628244152 2023-07-17 21:10:45,959 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:45,959 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 21:10:45,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/rep_barrier 2023-07-17 21:10:45,963 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 21:10:45,964 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:45,964 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 21:10:45,965 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38665] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:45,967 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/table 2023-07-17 21:10:45,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 21:10:45,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:45,971 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740 2023-07-17 21:10:45,973 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740 2023-07-17 21:10:45,974 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38665] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:45,975 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:10:45,975 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38145 2023-07-17 21:10:45,975 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 21:10:45,975 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38665] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:45,976 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:10:45,976 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38145 2023-07-17 21:10:45,976 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 21:10:45,979 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:10:45,979 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38145 2023-07-17 21:10:45,979 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 21:10:45,988 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 21:10:45,996 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 21:10:46,019 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:10:46,020 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:46,021 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71233021, jitterRate=0.06145472824573517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 21:10:46,021 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 21:10:46,021 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 21:10:46,021 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 21:10:46,021 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 21:10:46,021 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 21:10:46,021 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 21:10:46,023 DEBUG [RS:1;jenkins-hbase4:34535] zookeeper.ZKUtil(162): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,024 WARN [RS:1;jenkins-hbase4:34535] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:46,024 INFO [RS:1;jenkins-hbase4:34535] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,024 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,023 DEBUG [RS:0;jenkins-hbase4:42831] zookeeper.ZKUtil(162): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,024 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,025 WARN [RS:0;jenkins-hbase4:42831] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:46,025 WARN [RS:2;jenkins-hbase4:36811] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 21:10:46,028 INFO [RS:0;jenkins-hbase4:42831] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,030 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,028 INFO [RS:2;jenkins-hbase4:36811] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,031 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 21:10:46,031 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,031 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 21:10:46,041 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42831,1689628244018] 2023-07-17 21:10:46,041 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36811,1689628244152] 2023-07-17 21:10:46,041 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34535,1689628244104] 2023-07-17 21:10:46,057 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 21:10:46,057 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 21:10:46,063 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,064 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,063 DEBUG [RS:0;jenkins-hbase4:42831] zookeeper.ZKUtil(162): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,065 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,064 DEBUG [RS:1;jenkins-hbase4:34535] zookeeper.ZKUtil(162): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,065 DEBUG [RS:0;jenkins-hbase4:42831] zookeeper.ZKUtil(162): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,066 DEBUG [RS:0;jenkins-hbase4:42831] zookeeper.ZKUtil(162): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,066 DEBUG [RS:1;jenkins-hbase4:34535] zookeeper.ZKUtil(162): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,068 DEBUG [RS:1;jenkins-hbase4:34535] zookeeper.ZKUtil(162): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,079 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 21:10:46,079 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 21:10:46,079 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 21:10:46,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 21:10:46,094 INFO [RS:1;jenkins-hbase4:34535] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 21:10:46,095 INFO [RS:0;jenkins-hbase4:42831] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 21:10:46,094 INFO [RS:2;jenkins-hbase4:36811] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 21:10:46,102 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 21:10:46,106 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 21:10:46,129 INFO [RS:2;jenkins-hbase4:36811] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 21:10:46,130 INFO [RS:1;jenkins-hbase4:34535] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 21:10:46,135 INFO [RS:0;jenkins-hbase4:42831] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 21:10:46,141 INFO [RS:2;jenkins-hbase4:36811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 21:10:46,141 INFO [RS:0;jenkins-hbase4:42831] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 21:10:46,141 INFO [RS:1;jenkins-hbase4:34535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 21:10:46,142 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,142 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,143 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,143 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 21:10:46,147 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 21:10:46,147 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 21:10:46,165 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,165 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,165 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,165 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,171 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:46,172 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,172 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:1;jenkins-hbase4:34535] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,173 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,174 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 21:10:46,174 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,174 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,174 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,174 DEBUG [RS:0;jenkins-hbase4:42831] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 21:10:46,177 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,177 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,178 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,178 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,178 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,178 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,178 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,178 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,179 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,199 INFO [RS:0;jenkins-hbase4:42831] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 21:10:46,199 INFO [RS:1;jenkins-hbase4:34535] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 21:10:46,199 INFO [RS:2;jenkins-hbase4:36811] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 21:10:46,203 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42831,1689628244018-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,203 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1689628244152-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,203 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34535,1689628244104-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,231 INFO [RS:1;jenkins-hbase4:34535] regionserver.Replication(203): jenkins-hbase4.apache.org,34535,1689628244104 started 2023-07-17 21:10:46,231 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34535,1689628244104, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34535, sessionid=0x101751f711f0002 2023-07-17 21:10:46,232 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 21:10:46,232 DEBUG [RS:1;jenkins-hbase4:34535] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,232 DEBUG [RS:1;jenkins-hbase4:34535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34535,1689628244104' 2023-07-17 21:10:46,232 DEBUG [RS:1;jenkins-hbase4:34535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 21:10:46,233 DEBUG [RS:1;jenkins-hbase4:34535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 21:10:46,234 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 21:10:46,234 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 21:10:46,234 DEBUG [RS:1;jenkins-hbase4:34535] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:46,234 DEBUG [RS:1;jenkins-hbase4:34535] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34535,1689628244104' 2023-07-17 21:10:46,234 DEBUG [RS:1;jenkins-hbase4:34535] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:46,235 DEBUG [RS:1;jenkins-hbase4:34535] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:46,236 DEBUG [RS:1;jenkins-hbase4:34535] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 21:10:46,236 INFO [RS:1;jenkins-hbase4:34535] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 21:10:46,236 INFO [RS:1;jenkins-hbase4:34535] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 21:10:46,236 INFO [RS:2;jenkins-hbase4:36811] regionserver.Replication(203): jenkins-hbase4.apache.org,36811,1689628244152 started 2023-07-17 21:10:46,237 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36811,1689628244152, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36811, sessionid=0x101751f711f0003 2023-07-17 21:10:46,239 INFO [RS:0;jenkins-hbase4:42831] regionserver.Replication(203): jenkins-hbase4.apache.org,42831,1689628244018 started 2023-07-17 21:10:46,239 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 21:10:46,239 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42831,1689628244018, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42831, sessionid=0x101751f711f0001 2023-07-17 21:10:46,240 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 21:10:46,240 DEBUG [RS:0;jenkins-hbase4:42831] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,240 DEBUG [RS:0;jenkins-hbase4:42831] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42831,1689628244018' 2023-07-17 21:10:46,241 DEBUG [RS:0;jenkins-hbase4:42831] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 21:10:46,239 DEBUG [RS:2;jenkins-hbase4:36811] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,241 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36811,1689628244152' 2023-07-17 21:10:46,241 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 21:10:46,241 DEBUG [RS:0;jenkins-hbase4:42831] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 21:10:46,242 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 21:10:46,242 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 21:10:46,242 DEBUG [RS:0;jenkins-hbase4:42831] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,242 DEBUG [RS:0;jenkins-hbase4:42831] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42831,1689628244018' 2023-07-17 21:10:46,243 DEBUG [RS:0;jenkins-hbase4:42831] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:46,246 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 21:10:46,246 DEBUG [RS:0;jenkins-hbase4:42831] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:46,247 DEBUG [RS:0;jenkins-hbase4:42831] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 21:10:46,247 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 21:10:46,247 INFO [RS:0;jenkins-hbase4:42831] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 21:10:46,248 INFO [RS:0;jenkins-hbase4:42831] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 21:10:46,255 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 21:10:46,255 DEBUG [RS:2;jenkins-hbase4:36811] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:46,255 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36811,1689628244152' 2023-07-17 21:10:46,255 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:46,256 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:46,258 DEBUG [jenkins-hbase4:38665] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 21:10:46,264 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 21:10:46,264 INFO [RS:2;jenkins-hbase4:36811] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 21:10:46,264 INFO [RS:2;jenkins-hbase4:36811] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 21:10:46,268 DEBUG [jenkins-hbase4:38665] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:46,275 DEBUG [jenkins-hbase4:38665] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:46,275 DEBUG [jenkins-hbase4:38665] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:46,275 DEBUG [jenkins-hbase4:38665] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:46,275 DEBUG [jenkins-hbase4:38665] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:46,279 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42831,1689628244018, state=OPENING 2023-07-17 21:10:46,290 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 21:10:46,294 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:46,295 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 21:10:46,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:10:46,353 INFO [RS:1;jenkins-hbase4:34535] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34535%2C1689628244104, suffix=, logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,34535,1689628244104, archiveDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs, maxLogs=32 2023-07-17 21:10:46,361 INFO [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42831%2C1689628244018, suffix=, logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,42831,1689628244018, archiveDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs, maxLogs=32 2023-07-17 21:10:46,367 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36811%2C1689628244152, suffix=, logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,36811,1689628244152, archiveDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs, maxLogs=32 2023-07-17 21:10:46,396 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK] 2023-07-17 21:10:46,396 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK] 2023-07-17 21:10:46,397 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK] 2023-07-17 21:10:46,420 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK] 2023-07-17 21:10:46,421 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK] 2023-07-17 21:10:46,423 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK] 2023-07-17 21:10:46,424 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK] 2023-07-17 21:10:46,426 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK] 2023-07-17 21:10:46,436 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK] 2023-07-17 21:10:46,452 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,36811,1689628244152/jenkins-hbase4.apache.org%2C36811%2C1689628244152.1689628246368 2023-07-17 21:10:46,453 DEBUG [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK], DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK], DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK]] 2023-07-17 21:10:46,455 INFO [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,42831,1689628244018/jenkins-hbase4.apache.org%2C42831%2C1689628244018.1689628246363 2023-07-17 21:10:46,458 DEBUG [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK], DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK], DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK]] 2023-07-17 21:10:46,461 INFO [RS:1;jenkins-hbase4:34535] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,34535,1689628244104/jenkins-hbase4.apache.org%2C34535%2C1689628244104.1689628246355 2023-07-17 21:10:46,466 DEBUG [RS:1;jenkins-hbase4:34535] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK], DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK], DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK]] 2023-07-17 21:10:46,502 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:46,506 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:10:46,509 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:10:46,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 21:10:46,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 21:10:46,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42831%2C1689628244018.meta, suffix=.meta, logDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,42831,1689628244018, archiveDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs, maxLogs=32 2023-07-17 21:10:46,563 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK] 2023-07-17 21:10:46,563 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK] 2023-07-17 21:10:46,563 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK] 2023-07-17 21:10:46,582 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/WALs/jenkins-hbase4.apache.org,42831,1689628244018/jenkins-hbase4.apache.org%2C42831%2C1689628244018.meta.1689628246536.meta 2023-07-17 21:10:46,584 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37901,DS-b0f0543a-d594-480b-8826-7e613f381536,DISK], DatanodeInfoWithStorage[127.0.0.1:36325,DS-754b6178-07a5-4f9c-8313-0f7dce32a14d,DISK], DatanodeInfoWithStorage[127.0.0.1:44689,DS-e18d04e8-cc5b-45b8-8500-4e2a6a3b022c,DISK]] 2023-07-17 21:10:46,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:46,588 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 21:10:46,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:46,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 21:10:46,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 21:10:46,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 21:10:46,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 21:10:46,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:46,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 21:10:46,614 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 21:10:46,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 21:10:46,619 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/info 2023-07-17 21:10:46,619 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/info 2023-07-17 21:10:46,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 21:10:46,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 21:10:46,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/rep_barrier 2023-07-17 21:10:46,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/rep_barrier 2023-07-17 21:10:46,624 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 21:10:46,625 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,625 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 21:10:46,627 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/table 2023-07-17 21:10:46,627 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/table 2023-07-17 21:10:46,628 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 21:10:46,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:46,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740 2023-07-17 21:10:46,636 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740 2023-07-17 21:10:46,640 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 21:10:46,642 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 21:10:46,644 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73469072, jitterRate=0.09477448463439941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 21:10:46,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 21:10:46,660 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689628246494 2023-07-17 21:10:46,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 21:10:46,685 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 21:10:46,692 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42831,1689628244018, state=OPEN 2023-07-17 21:10:46,702 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 21:10:46,702 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 21:10:46,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 21:10:46,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42831,1689628244018 in 405 msec 2023-07-17 21:10:46,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 21:10:46,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 631 msec 2023-07-17 21:10:46,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1320 sec 2023-07-17 21:10:46,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689628246734, completionTime=-1 2023-07-17 21:10:46,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 21:10:46,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 21:10:46,827 DEBUG [hconnection-0x16ba867e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:46,834 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:46,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 21:10:46,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689628306859 2023-07-17 21:10:46,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689628366859 2023-07-17 21:10:46,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 124 msec 2023-07-17 21:10:46,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38665,1689628242426-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38665,1689628242426-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38665,1689628242426-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38665, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 21:10:46,901 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 21:10:46,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 21:10:46,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:46,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 21:10:46,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:10:46,939 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:10:46,967 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:46,970 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70 empty. 2023-07-17 21:10:46,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:46,972 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 21:10:47,048 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:47,051 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19f3a62f59b7bf7beaaa1895627e9d70, NAME => 'hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:10:47,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:47,085 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 19f3a62f59b7bf7beaaa1895627e9d70, disabling compactions & flushes 2023-07-17 21:10:47,085 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. after waiting 0 ms 2023-07-17 21:10:47,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,086 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,086 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 19f3a62f59b7bf7beaaa1895627e9d70: 2023-07-17 21:10:47,092 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:10:47,110 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689628247095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628247095"}]},"ts":"1689628247095"} 2023-07-17 21:10:47,139 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 21:10:47,141 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:10:47,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628247141"}]},"ts":"1689628247141"} 2023-07-17 21:10:47,152 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 21:10:47,157 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:47,158 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:47,158 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:47,158 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:47,158 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:47,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=19f3a62f59b7bf7beaaa1895627e9d70, ASSIGN}] 2023-07-17 21:10:47,165 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=19f3a62f59b7bf7beaaa1895627e9d70, ASSIGN 2023-07-17 21:10:47,167 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=19f3a62f59b7bf7beaaa1895627e9d70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:10:47,319 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 21:10:47,320 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=19f3a62f59b7bf7beaaa1895627e9d70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:47,321 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689628247320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628247320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628247320"}]},"ts":"1689628247320"} 2023-07-17 21:10:47,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 19f3a62f59b7bf7beaaa1895627e9d70, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:10:47,483 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:47,484 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:10:47,487 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:10:47,494 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19f3a62f59b7bf7beaaa1895627e9d70, NAME => 'hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:47,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. service=AccessControlService 2023-07-17 21:10:47,495 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:47,495 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,495 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:47,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,498 INFO [StoreOpener-19f3a62f59b7bf7beaaa1895627e9d70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,500 DEBUG [StoreOpener-19f3a62f59b7bf7beaaa1895627e9d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/info 2023-07-17 21:10:47,500 DEBUG [StoreOpener-19f3a62f59b7bf7beaaa1895627e9d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/info 2023-07-17 21:10:47,501 INFO [StoreOpener-19f3a62f59b7bf7beaaa1895627e9d70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f3a62f59b7bf7beaaa1895627e9d70 columnFamilyName info 2023-07-17 21:10:47,502 INFO [StoreOpener-19f3a62f59b7bf7beaaa1895627e9d70-1] regionserver.HStore(310): Store=19f3a62f59b7bf7beaaa1895627e9d70/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:47,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:10:47,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:47,513 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19f3a62f59b7bf7beaaa1895627e9d70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73258687, jitterRate=0.09163950383663177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:47,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19f3a62f59b7bf7beaaa1895627e9d70: 2023-07-17 21:10:47,516 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70., pid=6, masterSystemTime=1689628247483 2023-07-17 21:10:47,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,520 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:10:47,522 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=19f3a62f59b7bf7beaaa1895627e9d70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:47,522 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689628247521"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628247521"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628247521"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628247521"}]},"ts":"1689628247521"} 2023-07-17 21:10:47,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 21:10:47,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 19f3a62f59b7bf7beaaa1895627e9d70, server=jenkins-hbase4.apache.org,34535,1689628244104 in 197 msec 2023-07-17 21:10:47,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 21:10:47,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=19f3a62f59b7bf7beaaa1895627e9d70, ASSIGN in 371 msec 2023-07-17 21:10:47,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:10:47,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628247538"}]},"ts":"1689628247538"} 2023-07-17 21:10:47,541 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 21:10:47,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:10:47,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 631 msec 2023-07-17 21:10:47,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 21:10:47,634 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 21:10:47,635 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:47,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:47,659 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:47,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 21:10:47,697 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 21:10:47,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-17 21:10:47,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 21:10:47,734 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 21:10:47,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 24 msec 2023-07-17 21:10:47,754 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 21:10:47,759 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 21:10:47,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.526sec 2023-07-17 21:10:47,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 21:10:47,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 21:10:47,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 21:10:47,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38665,1689628242426-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 21:10:47,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38665,1689628242426-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 21:10:47,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:47,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 21:10:47,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:10:47,799 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:10:47,802 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:47,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 21:10:47,803 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c empty. 2023-07-17 21:10:47,806 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:47,806 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 21:10:47,809 DEBUG [Listener at localhost/38753] zookeeper.ReadOnlyZKClient(139): Connect 0x3a81cdeb to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:47,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:47,814 DEBUG [Listener at localhost/38753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d781b9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:47,843 DEBUG [hconnection-0xf78cbdd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:47,856 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:47,859 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => bd817a1886d2af92cae5328f2e77495c, NAME => 'hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:10:47,860 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:47,863 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/test.cache.data in system properties and HBase conf 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop.log.dir in system properties and HBase conf 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 21:10:47,864 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/nfs.dump.dir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir in system properties and HBase conf 2023-07-17 21:10:47,865 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 21:10:47,866 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 21:10:47,866 INFO [Listener at localhost/38753] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 21:10:47,898 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:47,898 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing bd817a1886d2af92cae5328f2e77495c, disabling compactions & flushes 2023-07-17 21:10:47,899 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:47,899 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:47,899 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. after waiting 0 ms 2023-07-17 21:10:47,899 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:47,899 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:47,899 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for bd817a1886d2af92cae5328f2e77495c: 2023-07-17 21:10:47,913 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:10:47,915 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689628247915"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628247915"}]},"ts":"1689628247915"} 2023-07-17 21:10:47,918 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 21:10:47,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:47,920 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:10:47,920 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628247920"}]},"ts":"1689628247920"} 2023-07-17 21:10:47,923 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 21:10:47,929 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:47,930 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:47,930 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:47,930 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:47,930 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:47,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=bd817a1886d2af92cae5328f2e77495c, ASSIGN}] 2023-07-17 21:10:47,939 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=bd817a1886d2af92cae5328f2e77495c, ASSIGN 2023-07-17 21:10:47,960 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=bd817a1886d2af92cae5328f2e77495c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36811,1689628244152; forceNewPlan=false, retain=false 2023-07-17 21:10:48,111 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 21:10:48,112 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bd817a1886d2af92cae5328f2e77495c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:48,112 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689628248112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628248112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628248112"}]},"ts":"1689628248112"} 2023-07-17 21:10:48,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure bd817a1886d2af92cae5328f2e77495c, server=jenkins-hbase4.apache.org,36811,1689628244152}] 2023-07-17 21:10:48,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:48,271 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:48,273 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:10:48,274 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:10:48,300 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:48,300 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd817a1886d2af92cae5328f2e77495c, NAME => 'hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:10:48,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. service=AccessControlService 2023-07-17 21:10:48,301 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:48,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:48,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,307 INFO [StoreOpener-bd817a1886d2af92cae5328f2e77495c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,309 DEBUG [StoreOpener-bd817a1886d2af92cae5328f2e77495c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/l 2023-07-17 21:10:48,309 DEBUG [StoreOpener-bd817a1886d2af92cae5328f2e77495c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/l 2023-07-17 21:10:48,310 INFO [StoreOpener-bd817a1886d2af92cae5328f2e77495c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd817a1886d2af92cae5328f2e77495c columnFamilyName l 2023-07-17 21:10:48,314 INFO [StoreOpener-bd817a1886d2af92cae5328f2e77495c-1] regionserver.HStore(310): Store=bd817a1886d2af92cae5328f2e77495c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:48,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,318 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:10:48,341 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:48,342 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bd817a1886d2af92cae5328f2e77495c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67163406, jitterRate=8.127391338348389E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:48,342 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bd817a1886d2af92cae5328f2e77495c: 2023-07-17 21:10:48,345 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c., pid=11, masterSystemTime=1689628248271 2023-07-17 21:10:48,350 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:48,351 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:10:48,353 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=bd817a1886d2af92cae5328f2e77495c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:48,353 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689628248353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628248353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628248353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628248353"}]},"ts":"1689628248353"} 2023-07-17 21:10:48,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 21:10:48,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure bd817a1886d2af92cae5328f2e77495c, server=jenkins-hbase4.apache.org,36811,1689628244152 in 241 msec 2023-07-17 21:10:48,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 21:10:48,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=bd817a1886d2af92cae5328f2e77495c, ASSIGN in 436 msec 2023-07-17 21:10:48,373 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:10:48,373 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628248373"}]},"ts":"1689628248373"} 2023-07-17 21:10:48,377 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 21:10:48,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:10:48,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 593 msec 2023-07-17 21:10:48,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 21:10:48,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 21:10:48,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 21:10:49,403 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:49,781 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:49,789 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40127_jobhistory____kc4der/webapp 2023-07-17 21:10:49,991 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 21:10:49,991 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:49,991 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:49,994 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:50,084 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:50,417 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:50,869 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 21:10:50,968 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40127 2023-07-17 21:10:52,171 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:10:52,524 WARN [Listener at jenkins-hbase4.apache.org/36447] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:52,534 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 21:10:52,536 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 21:10:52,537 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 21:10:52,610 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:10:52,611 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 21:10:52,611 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:10:52,611 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 21:10:52,612 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 21:10:52,612 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 21:10:52,612 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:10:52,612 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 21:10:52,612 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 21:10:52,612 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 21:10:52,639 WARN [Listener at jenkins-hbase4.apache.org/36447] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 21:10:52,639 INFO [Listener at jenkins-hbase4.apache.org/36447] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:52,650 INFO [Listener at jenkins-hbase4.apache.org/36447] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44785_cluster____.k3lfio/webapp 2023-07-17 21:10:52,726 INFO [Listener at jenkins-hbase4.apache.org/36447] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:52,727 INFO [Listener at jenkins-hbase4.apache.org/36447] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 21:10:52,727 INFO [Listener at jenkins-hbase4.apache.org/36447] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:52,727 INFO [Listener at jenkins-hbase4.apache.org/36447] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:52,737 INFO [Listener at jenkins-hbase4.apache.org/36447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:52,936 INFO [Listener at jenkins-hbase4.apache.org/36447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,124 INFO [Listener at jenkins-hbase4.apache.org/36447] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,149 INFO [Listener at jenkins-hbase4.apache.org/36447] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44785 2023-07-17 21:10:53,662 WARN [Listener at jenkins-hbase4.apache.org/34081] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:53,690 WARN [Listener at jenkins-hbase4.apache.org/34081] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 21:10:53,690 INFO [Listener at jenkins-hbase4.apache.org/34081] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:53,701 INFO [Listener at jenkins-hbase4.apache.org/34081] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_32971_node____jzhd1u/webapp 2023-07-17 21:10:53,763 INFO [Listener at jenkins-hbase4.apache.org/34081] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 21:10:53,763 INFO [Listener at jenkins-hbase4.apache.org/34081] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:53,763 INFO [Listener at jenkins-hbase4.apache.org/34081] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:53,763 INFO [Listener at jenkins-hbase4.apache.org/34081] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:53,772 INFO [Listener at jenkins-hbase4.apache.org/34081] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,797 INFO [Listener at jenkins-hbase4.apache.org/34081] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,902 INFO [Listener at jenkins-hbase4.apache.org/34081] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:53,923 INFO [Listener at jenkins-hbase4.apache.org/34081] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:32971 2023-07-17 21:10:54,212 WARN [Listener at jenkins-hbase4.apache.org/41521] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 21:10:54,219 WARN [Listener at jenkins-hbase4.apache.org/41521] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 21:10:54,220 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 21:10:54,229 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35303_node____plqgwi/webapp 2023-07-17 21:10:54,281 INFO [Listener at jenkins-hbase4.apache.org/41521] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 21:10:54,281 INFO [Listener at jenkins-hbase4.apache.org/41521] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 21:10:54,281 INFO [Listener at jenkins-hbase4.apache.org/41521] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 21:10:54,281 INFO [Listener at jenkins-hbase4.apache.org/41521] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 21:10:54,289 INFO [Listener at jenkins-hbase4.apache.org/41521] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:54,309 INFO [Listener at jenkins-hbase4.apache.org/41521] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:54,404 INFO [Listener at jenkins-hbase4.apache.org/41521] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 21:10:54,435 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35303 2023-07-17 21:10:54,473 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 21:10:54,475 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:54,541 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=179, AvailableMemoryMB=4864 2023-07-17 21:10:54,541 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-17 21:10:54,558 DEBUG [Listener at jenkins-hbase4.apache.org/41521] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 21:10:54,563 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 21:10:54,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:10:54,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:10:54,583 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:10:54,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 21:10:54,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:10:54,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:54,599 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:54,615 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:54,615 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 empty. 2023-07-17 21:10:54,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:54,619 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e empty. 2023-07-17 21:10:54,622 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:54,623 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 21:10:54,665 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 21:10:54,667 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 44ef5e06f84c372d9ed33e9980377656, NAME => 'testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:10:54,668 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 69c4b645c790569d56a72884cd6e875e, NAME => 'testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:10:54,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:54,732 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:54,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 44ef5e06f84c372d9ed33e9980377656, disabling compactions & flushes 2023-07-17 21:10:54,733 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:54,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:54,733 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. after waiting 0 ms 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:54,734 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 44ef5e06f84c372d9ed33e9980377656: 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 69c4b645c790569d56a72884cd6e875e, disabling compactions & flushes 2023-07-17 21:10:54,734 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. after waiting 0 ms 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:54,734 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:54,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 69c4b645c790569d56a72884cd6e875e: 2023-07-17 21:10:54,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:10:54,740 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628254740"}]},"ts":"1689628254740"} 2023-07-17 21:10:54,740 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628254740"}]},"ts":"1689628254740"} 2023-07-17 21:10:54,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:10:54,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:10:54,805 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628254805"}]},"ts":"1689628254805"} 2023-07-17 21:10:54,807 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 21:10:54,812 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:10:54,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:10:54,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:10:54,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:10:54,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:10:54,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, ASSIGN}] 2023-07-17 21:10:54,818 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, ASSIGN 2023-07-17 21:10:54,818 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, ASSIGN 2023-07-17 21:10:54,819 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:10:54,819 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42831,1689628244018; forceNewPlan=false, retain=false 2023-07-17 21:10:54,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:54,969 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:10:54,972 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=69c4b645c790569d56a72884cd6e875e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:54,972 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=44ef5e06f84c372d9ed33e9980377656, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:54,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628254972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628254972"}]},"ts":"1689628254972"} 2023-07-17 21:10:54,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628254972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628254972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628254972"}]},"ts":"1689628254972"} 2023-07-17 21:10:54,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 69c4b645c790569d56a72884cd6e875e, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:10:54,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 44ef5e06f84c372d9ed33e9980377656, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:10:55,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:55,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69c4b645c790569d56a72884cd6e875e, NAME => 'testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:10:55,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. service=AccessControlService 2023-07-17 21:10:55,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:55,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:55,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,142 INFO [StoreOpener-69c4b645c790569d56a72884cd6e875e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,157 DEBUG [StoreOpener-69c4b645c790569d56a72884cd6e875e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf 2023-07-17 21:10:55,157 DEBUG [StoreOpener-69c4b645c790569d56a72884cd6e875e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf 2023-07-17 21:10:55,157 INFO [StoreOpener-69c4b645c790569d56a72884cd6e875e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69c4b645c790569d56a72884cd6e875e columnFamilyName cf 2023-07-17 21:10:55,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:55,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44ef5e06f84c372d9ed33e9980377656, NAME => 'testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:10:55,158 INFO [StoreOpener-69c4b645c790569d56a72884cd6e875e-1] regionserver.HStore(310): Store=69c4b645c790569d56a72884cd6e875e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:55,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. service=AccessControlService 2023-07-17 21:10:55,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:10:55,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:10:55,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:10:55,172 INFO [StoreOpener-44ef5e06f84c372d9ed33e9980377656-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:55,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69c4b645c790569d56a72884cd6e875e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75354144, jitterRate=0.1228642463684082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69c4b645c790569d56a72884cd6e875e: 2023-07-17 21:10:55,181 DEBUG [StoreOpener-44ef5e06f84c372d9ed33e9980377656-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf 2023-07-17 21:10:55,181 DEBUG [StoreOpener-44ef5e06f84c372d9ed33e9980377656-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf 2023-07-17 21:10:55,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e., pid=15, masterSystemTime=1689628255128 2023-07-17 21:10:55,182 INFO [StoreOpener-44ef5e06f84c372d9ed33e9980377656-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44ef5e06f84c372d9ed33e9980377656 columnFamilyName cf 2023-07-17 21:10:55,183 INFO [StoreOpener-44ef5e06f84c372d9ed33e9980377656-1] regionserver.HStore(310): Store=44ef5e06f84c372d9ed33e9980377656/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:10:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:55,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:55,187 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=69c4b645c790569d56a72884cd6e875e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,187 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628255187"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628255187"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628255187"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628255187"}]},"ts":"1689628255187"} 2023-07-17 21:10:55,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-17 21:10:55,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 69c4b645c790569d56a72884cd6e875e, server=jenkins-hbase4.apache.org,34535,1689628244104 in 216 msec 2023-07-17 21:10:55,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, ASSIGN in 380 msec 2023-07-17 21:10:55,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:55,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:10:55,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:10:55,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44ef5e06f84c372d9ed33e9980377656; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62063620, jitterRate=-0.07517999410629272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:10:55,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44ef5e06f84c372d9ed33e9980377656: 2023-07-17 21:10:55,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656., pid=16, masterSystemTime=1689628255129 2023-07-17 21:10:55,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:55,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:55,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=44ef5e06f84c372d9ed33e9980377656, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628255227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628255227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628255227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628255227"}]},"ts":"1689628255227"} 2023-07-17 21:10:55,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-17 21:10:55,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 44ef5e06f84c372d9ed33e9980377656, server=jenkins-hbase4.apache.org,42831,1689628244018 in 259 msec 2023-07-17 21:10:55,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-17 21:10:55,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, ASSIGN in 425 msec 2023-07-17 21:10:55,248 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:10:55,248 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628255248"}]},"ts":"1689628255248"} 2023-07-17 21:10:55,251 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 21:10:55,255 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:10:55,262 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 21:10:55,272 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,282 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,290 DEBUG [hconnection-0x32f2f16b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,292 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,301 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 21:10:55,338 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,338 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,338 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,338 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 21:10:55,338 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:10:55,346 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:10:55,346 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:10:55,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,346 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 21:10:55,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 775 msec 2023-07-17 21:10:55,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 21:10:55,709 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 21:10:55,709 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-17 21:10:55,710 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:55,715 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-17 21:10:55,716 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:55,716 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-17 21:10:55,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628255734 (current time:1689628255734). 2023-07-17 21:10:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:10:55,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x7900837c to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32455dee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:55,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,747 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7900837c to 127.0.0.1:53065 2023-07-17 21:10:55,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:55,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x676d5d1b to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:55,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54ac95a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:55,759 DEBUG [hconnection-0x6bf315a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,760 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:55,769 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:55,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x676d5d1b to 127.0.0.1:53065 2023-07-17 21:10:55,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:55,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 21:10:55,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:10:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:55,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:55,826 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:55,827 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689628855827 2023-07-17 21:10:55,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:55,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 21:10:55,831 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:55,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:55,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-17 21:10:55,834 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:55,835 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:10:55,835 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:10:55,835 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689628855835 2023-07-17 21:10:55,849 WARN [DataStreamer for file /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-17 21:10:55,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,864 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 21:10:55,864 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,865 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 21:10:55,865 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 21:10:55,866 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,866 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,876 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:55,876 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:55,876 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:55,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:55,876 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:55,877 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,877 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:55,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:55,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,879 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,879 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:10:55,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 21:10:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 21:10:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:55,881 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:55,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 21:10:55,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,882 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:55,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:55,886 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,896 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:55,897 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:55,897 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:55,897 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:55,897 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:55,897 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:55,897 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:55,900 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,901 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,901 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,901 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,901 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,902 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,901 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:55,902 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:55,902 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:55,902 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,902 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:55,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:55,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:55,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@418751c[Count = 1] remaining members to acquire global barrier 2023-07-17 21:10:55,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:55,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:55,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:55,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@418751c[Count = 0] remaining members to acquire global barrier 2023-07-17 21:10:55,911 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 21:10:55,911 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:55,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,914 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:55,914 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:55,914 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:55,915 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:10:55,915 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,915 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:10:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:55,920 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:55,921 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:55,921 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:55,921 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:55,922 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. started... 2023-07-17 21:10:55,925 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69c4b645c790569d56a72884cd6e875e: 2023-07-17 21:10:55,927 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,927 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. started... 2023-07-17 21:10:55,928 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44ef5e06f84c372d9ed33e9980377656: 2023-07-17 21:10:55,929 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:55,933 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:55,933 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:55,935 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:55,937 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:10:55,937 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:10:55,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:55,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:55,940 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:10:55,993 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. completed. 2023-07-17 21:10:55,993 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,994 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. completed. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:55,994 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:55,994 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:10:55,996 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:55,996 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,996 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:55,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:55,996 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:55,998 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:55,998 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:55,998 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:55,998 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:10:56,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 21:10:56,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:10:56,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 21:10:56,011 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 21:10:56,011 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:10:56,011 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:10:56,011 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,011 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,015 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,017 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,017 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,018 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,020 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,021 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,021 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,038 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,038 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,038 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,039 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,039 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,039 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,040 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,040 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,039 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,042 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,042 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,043 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,140 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:56,143 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:10:56,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 21:10:56,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,167 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 21:10:56,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689628255828Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689628256040 (+212 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689628256040Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689628256064 (+24 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689628256092 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689628256166 (+74 ms) 2023-07-17 21:10:56,168 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:56,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 338 msec 2023-07-17 21:10:56,443 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:56,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:56,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:10:56,472 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:56,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42831] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:10:56,476 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:56,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:10:56,485 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 21:10:56,486 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:56,489 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:10:56,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:56,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628256528 (current time:1689628256528). 2023-07-17 21:10:56,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:10:56,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x03bee4ac to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:56,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7aa494ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:56,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:56,542 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:56,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03bee4ac to 127.0.0.1:53065 2023-07-17 21:10:56,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:56,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x47533e69 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:10:56,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33bc29ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:10:56,551 DEBUG [hconnection-0x6d61c8d6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:56,554 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:56,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:10:56,561 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:10:56,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47533e69 to 127.0.0.1:53065 2023-07-17 21:10:56,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:10:56,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 21:10:56,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:10:56,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:56,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:56,568 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:56,569 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689628856569 2023-07-17 21:10:56,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 21:10:56,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 21:10:56,571 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:10:56,571 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:10:56,572 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 21:10:56,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:56,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-17 21:10:56,575 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:56,576 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689628856576 2023-07-17 21:10:56,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 21:10:56,594 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 21:10:56,594 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:56,595 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 21:10:56,595 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 21:10:56,596 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,596 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,598 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,598 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,598 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,598 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,599 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,599 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,600 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,600 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 21:10:56,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 21:10:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:56,601 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 21:10:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:10:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 21:10:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 21:10:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 21:10:56,607 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,607 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,608 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,609 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:56,609 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,609 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:10:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:56,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@267ed899[Count = 1] remaining members to acquire global barrier 2023-07-17 21:10:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 21:10:56,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@267ed899[Count = 0] remaining members to acquire global barrier 2023-07-17 21:10:56,615 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 21:10:56,615 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,621 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:56,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:10:56,621 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:56,621 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:56,621 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:56,621 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:10:56,621 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. started... 2023-07-17 21:10:56,622 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:10:56,622 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:10:56,622 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:56,622 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69c4b645c790569d56a72884cd6e875e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 21:10:56,622 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. started... 2023-07-17 21:10:56,622 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 44ef5e06f84c372d9ed33e9980377656 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 21:10:56,624 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:56,624 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,624 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:56,671 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:56,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:56,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:56,673 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:10:56,726 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/.tmp/cf/bcd8b30b9f54438098aa6665179e4b63 2023-07-17 21:10:56,727 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/.tmp/cf/11ebf926e48044979a7e4f7de33b08bb 2023-07-17 21:10:56,777 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/.tmp/cf/11ebf926e48044979a7e4f7de33b08bb as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf/11ebf926e48044979a7e4f7de33b08bb 2023-07-17 21:10:56,777 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/.tmp/cf/bcd8b30b9f54438098aa6665179e4b63 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf/bcd8b30b9f54438098aa6665179e4b63 2023-07-17 21:10:56,786 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf/bcd8b30b9f54438098aa6665179e4b63, entries=3, sequenceid=6, filesize=5.0 K 2023-07-17 21:10:56,787 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf/11ebf926e48044979a7e4f7de33b08bb, entries=47, sequenceid=6, filesize=8.0 K 2023-07-17 21:10:56,790 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 44ef5e06f84c372d9ed33e9980377656 in 168ms, sequenceid=6, compaction requested=false 2023-07-17 21:10:56,791 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 21:10:56,791 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 69c4b645c790569d56a72884cd6e875e in 169ms, sequenceid=6, compaction requested=false 2023-07-17 21:10:56,791 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 21:10:56,793 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69c4b645c790569d56a72884cd6e875e: 2023-07-17 21:10:56,793 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44ef5e06f84c372d9ed33e9980377656: 2023-07-17 21:10:56,794 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:56,794 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:56,795 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:56,795 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf/11ebf926e48044979a7e4f7de33b08bb] hfiles 2023-07-17 21:10:56,795 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf/11ebf926e48044979a7e4f7de33b08bb for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:56,794 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:10:56,795 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf/bcd8b30b9f54438098aa6665179e4b63] hfiles 2023-07-17 21:10:56,795 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf/bcd8b30b9f54438098aa6665179e4b63 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 21:10:56,822 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. completed. 2023-07-17 21:10:56,823 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:10:56,823 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. completed. 2023-07-17 21:10:56,823 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 21:10:56,823 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:10:56,825 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,825 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,825 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,825 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:56,827 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,827 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 21:10:56,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,827 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,827 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 21:10:56,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:10:56,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 21:10:56,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:10:56,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 21:10:56,836 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 21:10:56,836 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:10:56,836 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:10:56,836 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 21:10:56,836 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:10:56,844 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,843 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,844 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,844 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:10:56,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:10:56,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,847 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,847 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:10:56,847 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 21:10:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,858 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:10:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 21:10:56,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:10:56,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 21:10:56,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,858 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:10:56,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:10:56,859 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:10:56,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:10:56,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,873 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:56,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:56,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:10:56,876 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:10:56,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 21:10:56,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,930 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 21:10:56,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689628256570Consolidate snapshot: snaptb0-testExportWithTargetName at 1689628256859 (+289 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689628256860 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689628256864 (+4 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689628256880 (+16 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689628256930 (+50 ms) 2023-07-17 21:10:56,932 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 21:10:56,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 361 msec 2023-07-17 21:10:57,177 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:10:57,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 21:10:57,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:10:57,180 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180 2023-07-17 21:10:57,180 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38145, tgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180, rawTgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:10:57,227 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:10:57,227 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_399774308_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 21:10:57,227 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 21:10:57,253 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 21:10:57,339 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:57,340 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:57,341 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:57,341 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,404 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-5740321748126784399.jar 2023-07-17 21:10:58,405 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,405 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,477 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-5969896475002572672.jar 2023-07-17 21:10:58,478 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,478 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,479 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,479 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,480 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,480 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:10:58,481 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:10:58,481 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:10:58,482 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:10:58,482 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:10:58,482 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:10:58,483 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:10:58,483 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:10:58,484 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:10:58,484 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:10:58,485 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:10:58,489 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,489 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:10:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:10:58,491 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:10:58,491 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:10:59,967 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:10:59,984 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 21:10:59,994 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 21:11:00,586 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:00,588 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:00,665 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:11:01,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:07,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:09,331 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:12,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:14,015 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:11:14,017 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:11:14,026 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 21:11:14,026 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:11:14,027 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:11:14,027 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 21:11:14,028 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 21:11:14,028 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 21:11:14,028 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180/.hbase-snapshot/testExportWithTargetName 2023-07-17 21:11:14,029 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 21:11:14,029 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628257180/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 21:11:14,039 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 21:11:14,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 21:11:14,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,057 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628274057"}]},"ts":"1689628274057"} 2023-07-17 21:11:14,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,059 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 21:11:14,143 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 21:11:14,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, UNASSIGN}] 2023-07-17 21:11:14,148 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, UNASSIGN 2023-07-17 21:11:14,148 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, UNASSIGN 2023-07-17 21:11:14,149 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=44ef5e06f84c372d9ed33e9980377656, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:14,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=69c4b645c790569d56a72884cd6e875e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:14,149 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628274149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628274149"}]},"ts":"1689628274149"} 2023-07-17 21:11:14,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628274149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628274149"}]},"ts":"1689628274149"} 2023-07-17 21:11:14,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 44ef5e06f84c372d9ed33e9980377656, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:11:14,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 69c4b645c790569d56a72884cd6e875e, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:11:14,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:11:14,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44ef5e06f84c372d9ed33e9980377656, disabling compactions & flushes 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69c4b645c790569d56a72884cd6e875e, disabling compactions & flushes 2023-07-17 21:11:14,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:11:14,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. after waiting 0 ms 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:11:14,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. after waiting 0 ms 2023-07-17 21:11:14,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:11:14,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:14,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:14,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:14,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:14,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e. 2023-07-17 21:11:14,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656. 2023-07-17 21:11:14,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69c4b645c790569d56a72884cd6e875e: 2023-07-17 21:11:14,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44ef5e06f84c372d9ed33e9980377656: 2023-07-17 21:11:14,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69c4b645c790569d56a72884cd6e875e 2023-07-17 21:11:14,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=69c4b645c790569d56a72884cd6e875e, regionState=CLOSED 2023-07-17 21:11:14,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:11:14,335 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628274334"}]},"ts":"1689628274334"} 2023-07-17 21:11:14,335 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=44ef5e06f84c372d9ed33e9980377656, regionState=CLOSED 2023-07-17 21:11:14,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689628274335"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628274335"}]},"ts":"1689628274335"} 2023-07-17 21:11:14,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-17 21:11:14,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 69c4b645c790569d56a72884cd6e875e, server=jenkins-hbase4.apache.org,34535,1689628244104 in 183 msec 2023-07-17 21:11:14,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-17 21:11:14,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 44ef5e06f84c372d9ed33e9980377656, server=jenkins-hbase4.apache.org,42831,1689628244018 in 185 msec 2023-07-17 21:11:14,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69c4b645c790569d56a72884cd6e875e, UNASSIGN in 195 msec 2023-07-17 21:11:14,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-17 21:11:14,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=44ef5e06f84c372d9ed33e9980377656, UNASSIGN in 196 msec 2023-07-17 21:11:14,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628274344"}]},"ts":"1689628274344"} 2023-07-17 21:11:14,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 21:11:14,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,404 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 21:11:14,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 359 msec 2023-07-17 21:11:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 21:11:14,662 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 21:11:14,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 21:11:14,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,678 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 21:11:14,681 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,684 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 21:11:14,687 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:11:14,687 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e 2023-07-17 21:11:14,690 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/recovered.edits] 2023-07-17 21:11:14,690 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/recovered.edits] 2023-07-17 21:11:14,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf/bcd8b30b9f54438098aa6665179e4b63 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/cf/bcd8b30b9f54438098aa6665179e4b63 2023-07-17 21:11:14,698 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf/11ebf926e48044979a7e4f7de33b08bb to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/cf/11ebf926e48044979a7e4f7de33b08bb 2023-07-17 21:11:14,702 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656/recovered.edits/9.seqid 2023-07-17 21:11:14,702 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e/recovered.edits/9.seqid 2023-07-17 21:11:14,703 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/44ef5e06f84c372d9ed33e9980377656 2023-07-17 21:11:14,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportWithTargetName/69c4b645c790569d56a72884cd6e875e 2023-07-17 21:11:14,703 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 21:11:14,706 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,727 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 21:11:14,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 21:11:14,733 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,733 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 21:11:14,733 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628274733"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:14,733 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628274733"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:14,736 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:11:14,736 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 44ef5e06f84c372d9ed33e9980377656, NAME => 'testtb-testExportWithTargetName,,1689628254571.44ef5e06f84c372d9ed33e9980377656.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 69c4b645c790569d56a72884cd6e875e, NAME => 'testtb-testExportWithTargetName,1,1689628254571.69c4b645c790569d56a72884cd6e875e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:11:14,736 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 21:11:14,736 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628274736"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:14,739 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 21:11:14,783 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 21:11:14,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 115 msec 2023-07-17 21:11:14,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,820 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 21:11:14,821 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 21:11:14,821 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 21:11:14,821 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,882 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:14,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 21:11:14,885 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 21:11:14,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 21:11:14,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 21:11:14,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 21:11:14,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 21:11:14,940 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:37461 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1232711921_1 at /127.0.0.1:60108 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:45771 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1232711921_1 at /127.0.0.1:53190 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:50766 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:53204 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:60128 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 254) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=3118 (was 4864) 2023-07-17 21:11:14,940 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-17 21:11:14,960 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=183, AvailableMemoryMB=3117 2023-07-17 21:11:14,960 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-17 21:11:14,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:11:14,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:14,967 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:11:14,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 21:11:14,968 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:11:14,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:14,971 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:14,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:14,972 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f empty. 2023-07-17 21:11:14,972 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa empty. 2023-07-17 21:11:14,973 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:14,973 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:14,973 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 21:11:14,999 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 21:11:15,000 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 27e6002355e671bae3efc4dfbc97918f, NAME => 'testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:11:15,001 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9dea6c123b6c007782f5e32d38292daa, NAME => 'testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:11:15,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:15,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 27e6002355e671bae3efc4dfbc97918f, disabling compactions & flushes 2023-07-17 21:11:15,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. after waiting 0 ms 2023-07-17 21:11:15,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,027 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 27e6002355e671bae3efc4dfbc97918f: 2023-07-17 21:11:15,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:15,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9dea6c123b6c007782f5e32d38292daa, disabling compactions & flushes 2023-07-17 21:11:15,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. after waiting 0 ms 2023-07-17 21:11:15,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9dea6c123b6c007782f5e32d38292daa: 2023-07-17 21:11:15,033 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:11:15,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628275034"}]},"ts":"1689628275034"} 2023-07-17 21:11:15,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628275034"}]},"ts":"1689628275034"} 2023-07-17 21:11:15,037 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:11:15,038 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:11:15,038 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628275038"}]},"ts":"1689628275038"} 2023-07-17 21:11:15,039 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 21:11:15,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:15,166 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:11:15,168 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:11:15,168 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:11:15,168 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:11:15,168 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:11:15,168 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, ASSIGN}] 2023-07-17 21:11:15,171 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, ASSIGN 2023-07-17 21:11:15,171 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, ASSIGN 2023-07-17 21:11:15,173 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42831,1689628244018; forceNewPlan=false, retain=false 2023-07-17 21:11:15,173 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:11:15,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:15,323 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:11:15,326 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=27e6002355e671bae3efc4dfbc97918f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9dea6c123b6c007782f5e32d38292daa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,327 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628275326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628275326"}]},"ts":"1689628275326"} 2023-07-17 21:11:15,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628275326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628275326"}]},"ts":"1689628275326"} 2023-07-17 21:11:15,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 27e6002355e671bae3efc4dfbc97918f, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:11:15,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 9dea6c123b6c007782f5e32d38292daa, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:11:15,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27e6002355e671bae3efc4dfbc97918f, NAME => 'testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:11:15,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. service=AccessControlService 2023-07-17 21:11:15,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:15,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:15,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,497 INFO [StoreOpener-27e6002355e671bae3efc4dfbc97918f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dea6c123b6c007782f5e32d38292daa, NAME => 'testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:11:15,499 DEBUG [StoreOpener-27e6002355e671bae3efc4dfbc97918f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf 2023-07-17 21:11:15,500 DEBUG [StoreOpener-27e6002355e671bae3efc4dfbc97918f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf 2023-07-17 21:11:15,500 INFO [StoreOpener-27e6002355e671bae3efc4dfbc97918f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27e6002355e671bae3efc4dfbc97918f columnFamilyName cf 2023-07-17 21:11:15,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. service=AccessControlService 2023-07-17 21:11:15,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:15,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,501 INFO [StoreOpener-27e6002355e671bae3efc4dfbc97918f-1] regionserver.HStore(310): Store=27e6002355e671bae3efc4dfbc97918f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:15,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:15,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,504 INFO [StoreOpener-9dea6c123b6c007782f5e32d38292daa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,508 DEBUG [StoreOpener-9dea6c123b6c007782f5e32d38292daa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf 2023-07-17 21:11:15,508 DEBUG [StoreOpener-9dea6c123b6c007782f5e32d38292daa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf 2023-07-17 21:11:15,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:15,509 INFO [StoreOpener-9dea6c123b6c007782f5e32d38292daa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dea6c123b6c007782f5e32d38292daa columnFamilyName cf 2023-07-17 21:11:15,509 INFO [StoreOpener-9dea6c123b6c007782f5e32d38292daa-1] regionserver.HStore(310): Store=9dea6c123b6c007782f5e32d38292daa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:15,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:15,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27e6002355e671bae3efc4dfbc97918f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70820697, jitterRate=0.05531062185764313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:15,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27e6002355e671bae3efc4dfbc97918f: 2023-07-17 21:11:15,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:15,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:15,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f., pid=30, masterSystemTime=1689628275485 2023-07-17 21:11:15,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9dea6c123b6c007782f5e32d38292daa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68793070, jitterRate=0.025096625089645386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:15,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9dea6c123b6c007782f5e32d38292daa: 2023-07-17 21:11:15,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa., pid=31, masterSystemTime=1689628275494 2023-07-17 21:11:15,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,532 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=27e6002355e671bae3efc4dfbc97918f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,533 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275532"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628275532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628275532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628275532"}]},"ts":"1689628275532"} 2023-07-17 21:11:15,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9dea6c123b6c007782f5e32d38292daa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,537 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628275535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628275535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628275535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628275535"}]},"ts":"1689628275535"} 2023-07-17 21:11:15,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-17 21:11:15,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 27e6002355e671bae3efc4dfbc97918f, server=jenkins-hbase4.apache.org,42831,1689628244018 in 206 msec 2023-07-17 21:11:15,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-17 21:11:15,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 9dea6c123b6c007782f5e32d38292daa, server=jenkins-hbase4.apache.org,34535,1689628244104 in 205 msec 2023-07-17 21:11:15,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, ASSIGN in 374 msec 2023-07-17 21:11:15,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-17 21:11:15,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, ASSIGN in 378 msec 2023-07-17 21:11:15,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:11:15,552 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628275552"}]},"ts":"1689628275552"} 2023-07-17 21:11:15,554 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 21:11:15,560 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:11:15,560 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 21:11:15,562 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:11:15,564 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,564 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,565 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,565 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:15,567 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:15,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:15,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 604 msec 2023-07-17 21:11:15,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 21:11:15,573 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 21:11:15,573 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 21:11:15,574 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:15,582 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 21:11:15,583 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:15,583 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-17 21:11:15,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628275605 (current time:1689628275605). 2023-07-17 21:11:15,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:15,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x739acd7f to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:15,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ad39275, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:15,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,621 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x739acd7f to 127.0.0.1:53065 2023-07-17 21:11:15,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:15,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x2baad6f2 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:15,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@efe07cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:15,635 DEBUG [hconnection-0x18287c5d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,638 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:15,644 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:15,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2baad6f2 to 127.0.0.1:53065 2023-07-17 21:11:15,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:15,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:11:15,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:15,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,651 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,652 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628875652 2023-07-17 21:11:15,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:15,653 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 21:11:15,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,656 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:15,656 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:15,657 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:15,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-17 21:11:15,661 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:15,662 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628875662 2023-07-17 21:11:15,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,679 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 21:11:15,679 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,680 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 21:11:15,680 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:11:15,681 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,681 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,682 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,682 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,682 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,682 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,683 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,683 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,684 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,684 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:15,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 21:11:15,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 21:11:15,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:15,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:15,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 21:11:15,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,686 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:15,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,688 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:15,690 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:15,690 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:15,691 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:15,691 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:15,691 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:15,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,692 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,697 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,697 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,697 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,697 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,697 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:15,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,698 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,698 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,698 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:15,698 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:15,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:15,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64f9c2fb[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:15,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64f9c2fb[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:15,703 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:11:15,703 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:15,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,704 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,704 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:15,705 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:15,705 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:15,704 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:15,705 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:15,705 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:15,705 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:15,705 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,705 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,705 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. started... 2023-07-17 21:11:15,705 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,705 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:11:15,705 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. started... 2023-07-17 21:11:15,705 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:15,708 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dea6c123b6c007782f5e32d38292daa: 2023-07-17 21:11:15,708 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27e6002355e671bae3efc4dfbc97918f: 2023-07-17 21:11:15,709 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,709 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,709 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:15,709 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:15,709 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:15,709 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:15,710 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:15,710 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,710 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:15,736 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. completed. 2023-07-17 21:11:15,736 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:15,736 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,737 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. completed. 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:15,737 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:11:15,739 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,739 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:15,739 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,739 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:15,741 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:15,741 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,741 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,741 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:15,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:11:15,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:11:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,757 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:11:15,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:11:15,757 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 21:11:15,757 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:15,757 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:15,757 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,757 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:15,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:15,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:15,758 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:15,759 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,761 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:15,762 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,763 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,765 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:15,766 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,768 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:15,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,776 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,776 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:15,776 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:15,777 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,777 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,777 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,779 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:15,779 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:15,779 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,779 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:15,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:15,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:15,958 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:15,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:15,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:15,960 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:11:16,023 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 21:11:16,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:16,024 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:16,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689628275653Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689628275776 (+123 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689628275777 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689628275785 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689628275880 (+95 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689628276023 (+143 ms) 2023-07-17 21:11:16,027 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:16,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 373 msec 2023-07-17 21:11:16,260 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:16,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:16,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:16,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42831] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:16,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:16,278 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 21:11:16,278 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:16,278 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:16,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:16,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628276290 (current time:1689628276290). 2023-07-17 21:11:16,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:16,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x3435937b to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:16,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@92d6bda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:16,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:16,301 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3435937b to 127.0.0.1:53065 2023-07-17 21:11:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:16,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x027484b8 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:16,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7853baef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:16,312 DEBUG [hconnection-0x6986523b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:16,313 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:16,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:16,319 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x027484b8 to 127.0.0.1:53065 2023-07-17 21:11:16,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:16,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:11:16,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:16,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:16,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:16,324 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:16,325 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628876325 2023-07-17 21:11:16,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 21:11:16,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:11:16,326 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:16,326 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:16,327 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:11:16,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:16,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-17 21:11:16,329 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:16,330 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628876330 2023-07-17 21:11:16,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 21:11:16,340 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 21:11:16,340 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,341 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 21:11:16,341 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:11:16,342 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,342 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,343 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,343 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,343 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,343 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,344 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,344 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,344 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,344 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 21:11:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,345 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:16,345 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:16,345 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,345 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:16,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 21:11:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:16,348 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 21:11:16,348 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 21:11:16,348 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 21:11:16,350 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,350 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,351 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@349374ed[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 21:11:16,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@349374ed[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:16,355 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:11:16,355 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:16,356 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,356 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:16,356 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:16,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,357 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,357 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:16,357 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. started... 2023-07-17 21:11:16,357 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:11:16,357 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:16,357 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:16,357 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:16,357 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9dea6c123b6c007782f5e32d38292daa 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 21:11:16,357 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:16,357 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. started... 2023-07-17 21:11:16,357 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:11:16,357 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:16,357 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 27e6002355e671bae3efc4dfbc97918f 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 21:11:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,359 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:16,378 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/.tmp/cf/813df3ba7b71455587baa62620350ea3 2023-07-17 21:11:16,379 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/.tmp/cf/620e8f0fdc32479cac840784c946105f 2023-07-17 21:11:16,389 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/.tmp/cf/620e8f0fdc32479cac840784c946105f as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf/620e8f0fdc32479cac840784c946105f 2023-07-17 21:11:16,389 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/.tmp/cf/813df3ba7b71455587baa62620350ea3 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf/813df3ba7b71455587baa62620350ea3 2023-07-17 21:11:16,396 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf/620e8f0fdc32479cac840784c946105f, entries=4, sequenceid=6, filesize=5.1 K 2023-07-17 21:11:16,397 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf/813df3ba7b71455587baa62620350ea3, entries=46, sequenceid=6, filesize=7.9 K 2023-07-17 21:11:16,399 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 27e6002355e671bae3efc4dfbc97918f in 42ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:16,399 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 21:11:16,399 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9dea6c123b6c007782f5e32d38292daa in 42ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:16,399 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 21:11:16,401 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27e6002355e671bae3efc4dfbc97918f: 2023-07-17 21:11:16,401 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9dea6c123b6c007782f5e32d38292daa: 2023-07-17 21:11:16,401 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,401 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,401 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:16,401 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:16,402 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf/813df3ba7b71455587baa62620350ea3] hfiles 2023-07-17 21:11:16,402 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf/620e8f0fdc32479cac840784c946105f] hfiles 2023-07-17 21:11:16,402 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf/813df3ba7b71455587baa62620350ea3 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,402 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf/620e8f0fdc32479cac840784c946105f for snapshot=snaptb0-testExportFileSystemState 2023-07-17 21:11:16,417 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. completed. 2023-07-17 21:11:16,417 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:16,417 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:16,417 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:16,417 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,417 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:16,417 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:11:16,419 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. completed. 2023-07-17 21:11:16,419 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:16,419 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:16,419 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:16,419 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,419 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 21:11:16,419 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:11:16,424 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:16,424 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,424 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,424 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:16,426 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,426 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 21:11:16,426 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:16,426 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,426 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 21:11:16,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:16,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:16,428 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:16,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:11:16,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:11:16,434 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 21:11:16,434 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:16,434 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:16,434 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 21:11:16,434 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:16,436 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,436 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,437 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:16,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,437 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,438 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:16,438 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:16,441 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 21:11:16,441 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,442 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,445 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,445 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,446 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,446 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,445 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,445 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:16,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,446 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:16,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:16,446 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,446 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:16,446 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:16,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,446 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 21:11:16,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 21:11:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,448 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 21:11:16,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,497 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689628276325Consolidate snapshot: snaptb0-testExportFileSystemState at 1689628276448 (+123 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689628276448Writing data manifest for snaptb0-testExportFileSystemState at 1689628276452 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689628276463 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689628276497 (+34 ms) 2023-07-17 21:11:16,500 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 21:11:16,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 174 msec 2023-07-17 21:11:16,629 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:16,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:11:16,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:16,634 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634 2023-07-17 21:11:16,634 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38145, tgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634, rawTgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:11:16,672 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:11:16,672 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_935633237_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:16,672 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 21:11:16,681 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 21:11:17,112 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,112 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,113 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:17,113 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,125 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-2866795054679593564.jar 2023-07-17 21:11:18,126 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,126 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,212 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-3987954079529499765.jar 2023-07-17 21:11:18,213 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,213 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,214 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,215 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,215 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,215 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:18,216 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:11:18,216 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:11:18,217 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:11:18,217 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:11:18,218 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:11:18,219 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:11:18,219 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:11:18,219 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:11:18,220 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:11:18,220 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:11:18,221 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:18,221 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:18,222 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:18,222 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:18,223 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:18,223 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:18,224 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:18,694 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:18,696 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 21:11:18,698 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 21:11:18,809 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:18,809 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:18,815 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0001_000001 (auth:SIMPLE) 2023-07-17 21:11:19,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:19,936 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:11:24,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:26,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:29,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:30,912 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:11:30,914 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:11:30,923 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 21:11:30,923 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:11:30,923 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:11:30,923 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 21:11:30,924 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 21:11:30,924 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 21:11:30,924 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 21:11:30,925 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 21:11:30,925 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628276634/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 21:11:30,932 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 21:11:30,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 21:11:30,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:30,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 21:11:30,937 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628290937"}]},"ts":"1689628290937"} 2023-07-17 21:11:30,939 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 21:11:30,940 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 21:11:30,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, UNASSIGN}] 2023-07-17 21:11:30,943 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, UNASSIGN 2023-07-17 21:11:30,943 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, UNASSIGN 2023-07-17 21:11:30,944 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=27e6002355e671bae3efc4dfbc97918f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:30,944 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9dea6c123b6c007782f5e32d38292daa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:30,944 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628290944"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628290944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628290944"}]},"ts":"1689628290944"} 2023-07-17 21:11:30,944 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628290944"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628290944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628290944"}]},"ts":"1689628290944"} 2023-07-17 21:11:30,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 27e6002355e671bae3efc4dfbc97918f, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:11:30,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 9dea6c123b6c007782f5e32d38292daa, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:11:31,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 21:11:31,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:31,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:31,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9dea6c123b6c007782f5e32d38292daa, disabling compactions & flushes 2023-07-17 21:11:31,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27e6002355e671bae3efc4dfbc97918f, disabling compactions & flushes 2023-07-17 21:11:31,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:31,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:31,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:31,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:31,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. after waiting 0 ms 2023-07-17 21:11:31,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. after waiting 0 ms 2023-07-17 21:11:31,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:31,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:31,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:31,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:11:31,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:31,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:11:31,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa. 2023-07-17 21:11:31,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9dea6c123b6c007782f5e32d38292daa: 2023-07-17 21:11:31,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f. 2023-07-17 21:11:31,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27e6002355e671bae3efc4dfbc97918f: 2023-07-17 21:11:31,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:31,115 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9dea6c123b6c007782f5e32d38292daa, regionState=CLOSED 2023-07-17 21:11:31,115 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628291115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291115"}]},"ts":"1689628291115"} 2023-07-17 21:11:31,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:31,115 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=27e6002355e671bae3efc4dfbc97918f, regionState=CLOSED 2023-07-17 21:11:31,116 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689628291115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291115"}]},"ts":"1689628291115"} 2023-07-17 21:11:31,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-17 21:11:31,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 9dea6c123b6c007782f5e32d38292daa, server=jenkins-hbase4.apache.org,34535,1689628244104 in 170 msec 2023-07-17 21:11:31,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-17 21:11:31,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 27e6002355e671bae3efc4dfbc97918f, server=jenkins-hbase4.apache.org,42831,1689628244018 in 171 msec 2023-07-17 21:11:31,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9dea6c123b6c007782f5e32d38292daa, UNASSIGN in 178 msec 2023-07-17 21:11:31,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-17 21:11:31,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=27e6002355e671bae3efc4dfbc97918f, UNASSIGN in 178 msec 2023-07-17 21:11:31,122 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628291122"}]},"ts":"1689628291122"} 2023-07-17 21:11:31,123 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 21:11:31,125 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 21:11:31,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-07-17 21:11:31,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 21:11:31,239 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 21:11:31,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 21:11:31,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,243 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 21:11:31,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,246 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 21:11:31,249 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,249 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,249 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,249 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,250 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:31,250 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:31,250 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 21:11:31,251 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,251 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 21:11:31,251 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-17 21:11:31,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-17 21:11:31,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-17 21:11:31,251 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,251 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,251 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:31,251 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:31,251 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:11:31,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 21:11:31,252 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/recovered.edits] 2023-07-17 21:11:31,252 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/recovered.edits] 2023-07-17 21:11:31,258 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf/620e8f0fdc32479cac840784c946105f to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/cf/620e8f0fdc32479cac840784c946105f 2023-07-17 21:11:31,259 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf/813df3ba7b71455587baa62620350ea3 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/cf/813df3ba7b71455587baa62620350ea3 2023-07-17 21:11:31,261 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f/recovered.edits/9.seqid 2023-07-17 21:11:31,262 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/27e6002355e671bae3efc4dfbc97918f 2023-07-17 21:11:31,262 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa/recovered.edits/9.seqid 2023-07-17 21:11:31,263 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemState/9dea6c123b6c007782f5e32d38292daa 2023-07-17 21:11:31,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 21:11:31,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,268 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 21:11:31,271 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 21:11:31,272 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,272 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 21:11:31,272 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628291272"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:31,272 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628291272"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:31,274 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:11:31,274 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 27e6002355e671bae3efc4dfbc97918f, NAME => 'testtb-testExportFileSystemState,,1689628274962.27e6002355e671bae3efc4dfbc97918f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9dea6c123b6c007782f5e32d38292daa, NAME => 'testtb-testExportFileSystemState,1,1689628274962.9dea6c123b6c007782f5e32d38292daa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:11:31,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 21:11:31,274 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628291274"}]},"ts":"9223372036854775807"} 2023-07-17 21:11:31,276 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 21:11:31,278 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 21:11:31,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-17 21:11:31,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 21:11:31,354 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 21:11:31,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 21:11:31,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 21:11:31,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 21:11:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 21:11:31,396 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:40391 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:52444 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:48098 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1939462304_1 at /127.0.0.1:44220 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:58874 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:41521 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=458 (was 280) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2995 (was 3117) 2023-07-17 21:11:31,397 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 21:11:31,419 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=458, ProcessCount=183, AvailableMemoryMB=2994 2023-07-17 21:11:31,419 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-17 21:11:31,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:11:31,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:11:31,426 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:11:31,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 21:11:31,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:31,428 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:11:31,432 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,432 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,432 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 empty. 2023-07-17 21:11:31,433 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd empty. 2023-07-17 21:11:31,433 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,434 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,434 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 21:11:31,454 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 21:11:31,456 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 593de6edb9579917034cd64062e85fa0, NAME => 'testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:11:31,456 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => db70908c609fe20009cb7e3447237acd, NAME => 'testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:11:31,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:31,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing db70908c609fe20009cb7e3447237acd, disabling compactions & flushes 2023-07-17 21:11:31,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:31,491 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 593de6edb9579917034cd64062e85fa0, disabling compactions & flushes 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,491 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. after waiting 0 ms 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. after waiting 0 ms 2023-07-17 21:11:31,491 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for db70908c609fe20009cb7e3447237acd: 2023-07-17 21:11:31,491 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,491 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 593de6edb9579917034cd64062e85fa0: 2023-07-17 21:11:31,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:11:31,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291495"}]},"ts":"1689628291495"} 2023-07-17 21:11:31,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628291495"}]},"ts":"1689628291495"} 2023-07-17 21:11:31,497 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:11:31,498 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:11:31,498 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628291498"}]},"ts":"1689628291498"} 2023-07-17 21:11:31,500 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 21:11:31,504 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:11:31,506 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:11:31,506 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:11:31,506 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:11:31,506 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:11:31,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, ASSIGN}] 2023-07-17 21:11:31,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, ASSIGN 2023-07-17 21:11:31,509 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, ASSIGN 2023-07-17 21:11:31,509 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36811,1689628244152; forceNewPlan=false, retain=false 2023-07-17 21:11:31,509 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:11:31,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:31,660 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:11:31,662 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=593de6edb9579917034cd64062e85fa0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:31,662 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=db70908c609fe20009cb7e3447237acd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:31,663 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628291662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628291662"}]},"ts":"1689628291662"} 2023-07-17 21:11:31,663 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628291662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628291662"}]},"ts":"1689628291662"} 2023-07-17 21:11:31,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 593de6edb9579917034cd64062e85fa0, server=jenkins-hbase4.apache.org,36811,1689628244152}] 2023-07-17 21:11:31,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure db70908c609fe20009cb7e3447237acd, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:11:31,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:31,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db70908c609fe20009cb7e3447237acd, NAME => 'testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:11:31,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 593de6edb9579917034cd64062e85fa0, NAME => 'testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:11:31,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. service=AccessControlService 2023-07-17 21:11:31,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. service=AccessControlService 2023-07-17 21:11:31,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:31,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:11:31,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:11:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,830 INFO [StoreOpener-db70908c609fe20009cb7e3447237acd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,831 INFO [StoreOpener-593de6edb9579917034cd64062e85fa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,832 DEBUG [StoreOpener-db70908c609fe20009cb7e3447237acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf 2023-07-17 21:11:31,832 DEBUG [StoreOpener-db70908c609fe20009cb7e3447237acd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf 2023-07-17 21:11:31,832 INFO [StoreOpener-db70908c609fe20009cb7e3447237acd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db70908c609fe20009cb7e3447237acd columnFamilyName cf 2023-07-17 21:11:31,833 DEBUG [StoreOpener-593de6edb9579917034cd64062e85fa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf 2023-07-17 21:11:31,833 DEBUG [StoreOpener-593de6edb9579917034cd64062e85fa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf 2023-07-17 21:11:31,833 INFO [StoreOpener-593de6edb9579917034cd64062e85fa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 593de6edb9579917034cd64062e85fa0 columnFamilyName cf 2023-07-17 21:11:31,833 INFO [StoreOpener-db70908c609fe20009cb7e3447237acd-1] regionserver.HStore(310): Store=db70908c609fe20009cb7e3447237acd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:31,834 INFO [StoreOpener-593de6edb9579917034cd64062e85fa0-1] regionserver.HStore(310): Store=593de6edb9579917034cd64062e85fa0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:11:31,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db70908c609fe20009cb7e3447237acd 2023-07-17 21:11:31,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 593de6edb9579917034cd64062e85fa0 2023-07-17 21:11:31,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:31,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db70908c609fe20009cb7e3447237acd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68624555, jitterRate=0.022585555911064148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:31,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db70908c609fe20009cb7e3447237acd: 2023-07-17 21:11:31,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:11:31,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd., pid=46, masterSystemTime=1689628291817 2023-07-17 21:11:31,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 593de6edb9579917034cd64062e85fa0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69417920, jitterRate=0.034407615661621094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:11:31,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 593de6edb9579917034cd64062e85fa0: 2023-07-17 21:11:31,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0., pid=45, masterSystemTime=1689628291817 2023-07-17 21:11:31,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:31,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=db70908c609fe20009cb7e3447237acd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:31,847 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291846"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628291846"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628291846"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628291846"}]},"ts":"1689628291846"} 2023-07-17 21:11:31,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:31,848 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=593de6edb9579917034cd64062e85fa0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:31,848 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628291848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628291848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628291848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628291848"}]},"ts":"1689628291848"} 2023-07-17 21:11:31,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-17 21:11:31,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure db70908c609fe20009cb7e3447237acd, server=jenkins-hbase4.apache.org,34535,1689628244104 in 183 msec 2023-07-17 21:11:31,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-17 21:11:31,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, ASSIGN in 348 msec 2023-07-17 21:11:31,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 593de6edb9579917034cd64062e85fa0, server=jenkins-hbase4.apache.org,36811,1689628244152 in 187 msec 2023-07-17 21:11:31,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-17 21:11:31,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, ASSIGN in 352 msec 2023-07-17 21:11:31,864 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:11:31,864 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628291864"}]},"ts":"1689628291864"} 2023-07-17 21:11:31,866 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 21:11:31,868 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:11:31,868 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 21:11:31,870 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 21:11:31,872 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,872 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,872 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,872 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:11:31,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:31,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:31,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:31,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 21:11:31,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 452 msec 2023-07-17 21:11:32,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 21:11:32,032 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 21:11:32,032 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-17 21:11:32,032 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:32,035 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-17 21:11:32,036 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:32,036 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-17 21:11:32,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628292038 (current time:1689628292038). 2023-07-17 21:11:32,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:32,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x5dd0a3f8 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@617dc9ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,050 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dd0a3f8 to 127.0.0.1:53065 2023-07-17 21:11:32,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x1027de9f to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48306000, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,058 DEBUG [hconnection-0x478df243-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,061 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,067 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1027de9f to 127.0.0.1:53065 2023-07-17 21:11:32,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 21:11:32,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:32,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,072 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,073 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689628892073 2023-07-17 21:11:32,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 21:11:32,074 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:32,074 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:32,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,075 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-17 21:11:32,077 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,078 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689628892078 2023-07-17 21:11:32,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,090 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 21:11:32,090 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,091 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 21:11:32,091 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 21:11:32,092 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,092 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,094 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,094 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,094 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,094 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,094 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,094 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,095 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,097 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,097 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,097 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,101 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,101 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,101 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,097 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,101 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,101 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,103 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,104 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,104 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,104 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fd16d8b[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:32,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fd16d8b[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:32,109 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 21:11:32,109 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,110 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,110 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,110 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:11:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,111 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:32,111 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:32,111 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,111 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. started... 2023-07-17 21:11:32,111 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:32,111 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:32,111 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:32,112 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 593de6edb9579917034cd64062e85fa0: 2023-07-17 21:11:32,112 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. started... 2023-07-17 21:11:32,112 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:32,113 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,113 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:32,113 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db70908c609fe20009cb7e3447237acd: 2023-07-17 21:11:32,113 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:32,114 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,114 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:32,115 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:11:32,118 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,118 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,119 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,134 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. completed. 2023-07-17 21:11:32,134 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:32,134 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. completed. 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,134 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,134 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:11:32,136 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,137 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36811,1689628244152': 2023-07-17 21:11:32,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 21:11:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:11:32,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 21:11:32,145 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 21:11:32,145 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:32,145 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:32,145 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,145 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,147 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,147 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,148 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,148 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,150 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,151 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,151 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,157 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,157 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,156 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,156 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,157 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,158 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,158 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,159 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,159 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,159 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,158 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,174 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:32,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:32,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:32,176 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:32,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 21:11:32,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,219 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 21:11:32,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689628292073Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689628292157 (+84 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689628292158 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689628292167 (+9 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689628292190 (+23 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689628292219 (+29 ms) 2023-07-17 21:11:32,224 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 150 msec 2023-07-17 21:11:32,376 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:32,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:32,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:32,384 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:32,389 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:11:32,395 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 21:11:32,395 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:32,397 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:11:32,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628292408 (current time:1689628292408). 2023-07-17 21:11:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:11:32,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x27203089 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32d390e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,422 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27203089 to 127.0.0.1:53065 2023-07-17 21:11:32,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x2585afcd to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:11:32,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@387678c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:11:32,431 DEBUG [hconnection-0x2dfdb39e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,433 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:11:32,439 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:11:32,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2585afcd to 127.0.0.1:53065 2023-07-17 21:11:32,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:11:32,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 21:11:32,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:11:32,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,444 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,444 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689628892444 2023-07-17 21:11:32,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 21:11:32,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 21:11:32,446 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:11:32,446 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:11:32,446 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 21:11:32,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-17 21:11:32,448 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,449 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689628892449 2023-07-17 21:11:32,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 21:11:32,458 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 21:11:32,458 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,459 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 21:11:32,459 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 21:11:32,460 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,460 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,461 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,461 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,462 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,461 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,462 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,462 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,463 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,463 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 21:11:32,463 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,463 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,467 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,467 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 21:11:32,467 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,467 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:11:32,468 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,467 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 21:11:32,469 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 21:11:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,471 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,472 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,472 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,472 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,472 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,472 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,472 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,473 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,473 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:11:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b131d89[Count = 1] remaining members to acquire global barrier 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 21:11:32,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b131d89[Count = 0] remaining members to acquire global barrier 2023-07-17 21:11:32,477 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 21:11:32,477 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,480 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:32,480 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 21:11:32,480 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,481 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. started... 2023-07-17 21:11:32,480 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. started... 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:11:32,481 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:32,480 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:11:32,481 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing db70908c609fe20009cb7e3447237acd 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 21:11:32,480 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:11:32,481 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 593de6edb9579917034cd64062e85fa0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 21:11:32,481 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:11:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,483 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,514 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/.tmp/cf/2c4660490e9144028ab1bbb31f9daceb 2023-07-17 21:11:32,517 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/.tmp/cf/1ad485b11a234d07a68797eefa61a00b 2023-07-17 21:11:32,524 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/.tmp/cf/2c4660490e9144028ab1bbb31f9daceb as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf/2c4660490e9144028ab1bbb31f9daceb 2023-07-17 21:11:32,526 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/.tmp/cf/1ad485b11a234d07a68797eefa61a00b as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf/1ad485b11a234d07a68797eefa61a00b 2023-07-17 21:11:32,537 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf/2c4660490e9144028ab1bbb31f9daceb, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 21:11:32,537 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf/1ad485b11a234d07a68797eefa61a00b, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 21:11:32,539 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 593de6edb9579917034cd64062e85fa0 in 58ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:32,539 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 21:11:32,539 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for db70908c609fe20009cb7e3447237acd in 58ms, sequenceid=6, compaction requested=false 2023-07-17 21:11:32,539 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 593de6edb9579917034cd64062e85fa0: 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db70908c609fe20009cb7e3447237acd: 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf/2c4660490e9144028ab1bbb31f9daceb] hfiles 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf/2c4660490e9144028ab1bbb31f9daceb for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf/1ad485b11a234d07a68797eefa61a00b] hfiles 2023-07-17 21:11:32,541 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf/1ad485b11a234d07a68797eefa61a00b for snapshot=snaptb0-testConsecutiveExports 2023-07-17 21:11:32,546 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:32,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:32,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:11:32,547 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:11:32,568 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. completed. 2023-07-17 21:11:32,568 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:11:32,568 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. completed. 2023-07-17 21:11:32,568 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:11:32,568 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 21:11:32,569 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:11:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,571 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,571 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,571 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 21:11:32,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,572 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 21:11:32,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36811,1689628244152': 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:11:32,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 21:11:32,581 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 21:11:32,581 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:11:32,581 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:11:32,581 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 21:11:32,581 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,583 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:11:32,584 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:11:32,585 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,585 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:11:32,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,588 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:11:32,594 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 21:11:32,595 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,603 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,603 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,603 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,603 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,603 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,604 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:11:32,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:11:32,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 21:11:32,603 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 21:11:32,604 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,604 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:11:32,604 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,604 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-17 21:11:32,604 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:11:32,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:11:32,604 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:11:32,606 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,607 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:11:32,607 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:11:32,607 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,607 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:11:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:11:32,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 21:11:32,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,656 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689628292444Consolidate snapshot: snaptb0-testConsecutiveExports at 1689628292604 (+160 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689628292604Writing data manifest for snaptb0-testConsecutiveExports at 1689628292611 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689628292622 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689628292655 (+33 ms) 2023-07-17 21:11:32,659 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 21:11:32,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 214 msec 2023-07-17 21:11:32,748 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:11:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 21:11:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:11:32,749 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749 2023-07-17 21:11:32,750 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:11:32,775 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:11:32,775 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@33ee0059, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,775 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 21:11:32,784 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:32,797 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:32,798 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:32,798 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:32,798 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,746 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-5196753432467636380.jar 2023-07-17 21:11:33,746 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,747 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,817 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-6277916480884685259.jar 2023-07-17 21:11:33,818 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,818 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,819 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,819 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,819 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,820 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:33,820 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:11:33,821 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:11:33,821 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:11:33,821 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:11:33,822 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:11:33,822 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:11:33,822 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:11:33,823 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:11:33,823 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:11:33,824 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:11:33,824 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:33,825 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:33,825 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:33,826 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:33,826 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:33,826 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:33,827 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:34,283 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:34,286 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 21:11:34,292 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 21:11:35,806 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:35,806 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:35,809 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0002_000001 (auth:SIMPLE) 2023-07-17 21:11:35,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:36,705 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:11:40,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:42,585 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:46,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:47,580 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:11:47,580 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:11:47,585 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 21:11:47,585 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:11:47,586 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:11:47,586 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:11:47,587 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:11:47,587 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:11:47,587 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@694eb25e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:11:47,587 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:11:47,587 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:11:47,588 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:11:47,610 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:11:47,610 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@12e49628, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:47,610 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 21:11:47,619 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 21:11:47,631 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:47,631 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:47,631 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:47,632 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,528 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-6562407039446740052.jar 2023-07-17 21:11:48,529 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,529 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,604 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-7969241498935938242.jar 2023-07-17 21:11:48,604 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,605 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,605 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,606 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,606 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,606 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:11:48,607 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:11:48,607 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:11:48,607 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:11:48,608 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:11:48,608 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:11:48,609 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:11:48,609 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:11:48,609 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:11:48,610 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:11:48,610 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:11:48,611 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:48,611 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:48,612 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:48,612 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:48,612 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:11:48,613 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:48,613 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:11:49,084 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:11:49,087 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 21:11:49,089 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 21:11:52,191 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:52,191 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:11:52,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0003_000001 (auth:SIMPLE) 2023-07-17 21:11:52,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0004_000001 (auth:SIMPLE) 2023-07-17 21:11:57,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0004_000001 (auth:SIMPLE) 2023-07-17 21:11:59,815 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0004_000001 (auth:SIMPLE) 2023-07-17 21:12:03,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0004_000001 (auth:SIMPLE) 2023-07-17 21:12:05,332 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:12:05,333 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:12:05,337 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 21:12:05,337 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:12:05,338 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:12:05,338 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:12:05,342 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:12:05,342 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:12:05,342 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@694eb25e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 21:12:05,343 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 21:12:05,343 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/local-export-1689628292749/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 21:12:05,361 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 21:12:05,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 21:12:05,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 21:12:05,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628325367"}]},"ts":"1689628325367"} 2023-07-17 21:12:05,369 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 21:12:05,371 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 21:12:05,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, UNASSIGN}] 2023-07-17 21:12:05,374 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, UNASSIGN 2023-07-17 21:12:05,374 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, UNASSIGN 2023-07-17 21:12:05,375 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=593de6edb9579917034cd64062e85fa0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:05,375 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=db70908c609fe20009cb7e3447237acd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:05,376 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325375"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628325375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628325375"}]},"ts":"1689628325375"} 2023-07-17 21:12:05,376 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325375"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628325375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628325375"}]},"ts":"1689628325375"} 2023-07-17 21:12:05,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 593de6edb9579917034cd64062e85fa0, server=jenkins-hbase4.apache.org,36811,1689628244152}] 2023-07-17 21:12:05,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure db70908c609fe20009cb7e3447237acd, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:05,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 21:12:05,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 593de6edb9579917034cd64062e85fa0 2023-07-17 21:12:05,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 593de6edb9579917034cd64062e85fa0, disabling compactions & flushes 2023-07-17 21:12:05,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:12:05,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:12:05,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. after waiting 0 ms 2023-07-17 21:12:05,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:12:05,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db70908c609fe20009cb7e3447237acd 2023-07-17 21:12:05,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db70908c609fe20009cb7e3447237acd, disabling compactions & flushes 2023-07-17 21:12:05,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:12:05,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:12:05,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. after waiting 0 ms 2023-07-17 21:12:05,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:12:05,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:05,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:05,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0. 2023-07-17 21:12:05,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 593de6edb9579917034cd64062e85fa0: 2023-07-17 21:12:05,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:05,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:05,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd. 2023-07-17 21:12:05,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db70908c609fe20009cb7e3447237acd: 2023-07-17 21:12:05,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 593de6edb9579917034cd64062e85fa0 2023-07-17 21:12:05,552 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=593de6edb9579917034cd64062e85fa0, regionState=CLOSED 2023-07-17 21:12:05,552 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628325552"}]},"ts":"1689628325552"} 2023-07-17 21:12:05,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db70908c609fe20009cb7e3447237acd 2023-07-17 21:12:05,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=db70908c609fe20009cb7e3447237acd, regionState=CLOSED 2023-07-17 21:12:05,554 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689628325554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628325554"}]},"ts":"1689628325554"} 2023-07-17 21:12:05,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-17 21:12:05,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 593de6edb9579917034cd64062e85fa0, server=jenkins-hbase4.apache.org,36811,1689628244152 in 177 msec 2023-07-17 21:12:05,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-17 21:12:05,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=593de6edb9579917034cd64062e85fa0, UNASSIGN in 185 msec 2023-07-17 21:12:05,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure db70908c609fe20009cb7e3447237acd, server=jenkins-hbase4.apache.org,34535,1689628244104 in 177 msec 2023-07-17 21:12:05,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-17 21:12:05,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=db70908c609fe20009cb7e3447237acd, UNASSIGN in 190 msec 2023-07-17 21:12:05,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628325565"}]},"ts":"1689628325565"} 2023-07-17 21:12:05,566 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 21:12:05,568 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 21:12:05,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 209 msec 2023-07-17 21:12:05,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 21:12:05,671 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 21:12:05,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 21:12:05,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 21:12:05,680 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 21:12:05,681 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,686 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,686 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,686 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,686 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 21:12:05,688 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,688 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,688 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,688 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,689 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,689 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 21:12:05,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 21:12:05,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:05,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-17 21:12:05,695 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 21:12:05,695 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd 2023-07-17 21:12:05,699 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 2023-07-17 21:12:05,710 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/recovered.edits] 2023-07-17 21:12:05,713 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/recovered.edits] 2023-07-17 21:12:05,718 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf/2c4660490e9144028ab1bbb31f9daceb to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/cf/2c4660490e9144028ab1bbb31f9daceb 2023-07-17 21:12:05,720 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf/1ad485b11a234d07a68797eefa61a00b to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/cf/1ad485b11a234d07a68797eefa61a00b 2023-07-17 21:12:05,723 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0/recovered.edits/9.seqid 2023-07-17 21:12:05,724 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/593de6edb9579917034cd64062e85fa0 2023-07-17 21:12:05,725 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd/recovered.edits/9.seqid 2023-07-17 21:12:05,726 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testConsecutiveExports/db70908c609fe20009cb7e3447237acd 2023-07-17 21:12:05,726 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 21:12:05,729 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,737 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 21:12:05,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 21:12:05,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 21:12:05,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628325745"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:05,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628325745"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:05,761 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:12:05,761 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => db70908c609fe20009cb7e3447237acd, NAME => 'testtb-testConsecutiveExports,,1689628291421.db70908c609fe20009cb7e3447237acd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 593de6edb9579917034cd64062e85fa0, NAME => 'testtb-testConsecutiveExports,1,1689628291421.593de6edb9579917034cd64062e85fa0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:12:05,761 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 21:12:05,761 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628325761"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:05,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 21:12:05,784 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 21:12:05,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 112 msec 2023-07-17 21:12:05,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 21:12:05,791 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 21:12:05,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 21:12:05,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 21:12:05,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 21:12:05,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 21:12:05,864 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=749 (was 764), OpenFileDescriptor=895 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=416 (was 458), ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2951 (was 2994) 2023-07-17 21:12:05,865 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-17 21:12:05,894 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=416, ProcessCount=185, AvailableMemoryMB=2948 2023-07-17 21:12:05,895 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-17 21:12:05,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:12:05,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:05,901 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:05,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 21:12:05,903 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:05,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:05,907 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:05,911 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b empty. 2023-07-17 21:12:05,911 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:05,911 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:05,911 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 empty. 2023-07-17 21:12:05,912 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:05,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 21:12:05,944 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:05,947 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 10054615cd2d344cf28086e9004b505b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:05,947 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 222094a5d10667beb859731f1bb3a492, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:05,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:05,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 10054615cd2d344cf28086e9004b505b, disabling compactions & flushes 2023-07-17 21:12:05,992 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:05,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:05,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. after waiting 0 ms 2023-07-17 21:12:05,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:05,992 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:05,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 10054615cd2d344cf28086e9004b505b: 2023-07-17 21:12:05,993 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:05,993 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 222094a5d10667beb859731f1bb3a492, disabling compactions & flushes 2023-07-17 21:12:05,993 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:05,993 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:05,994 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. after waiting 0 ms 2023-07-17 21:12:05,994 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:05,994 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:05,994 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 222094a5d10667beb859731f1bb3a492: 2023-07-17 21:12:06,001 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:06,002 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628326002"}]},"ts":"1689628326002"} 2023-07-17 21:12:06,002 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628326002"}]},"ts":"1689628326002"} 2023-07-17 21:12:06,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:06,009 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:06,010 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:06,010 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628326010"}]},"ts":"1689628326010"} 2023-07-17 21:12:06,012 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 21:12:06,015 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:06,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:06,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:06,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:06,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:06,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, ASSIGN}] 2023-07-17 21:12:06,024 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, ASSIGN 2023-07-17 21:12:06,024 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, ASSIGN 2023-07-17 21:12:06,025 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42831,1689628244018; forceNewPlan=false, retain=false 2023-07-17 21:12:06,025 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:12:06,175 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:06,180 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=10054615cd2d344cf28086e9004b505b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,180 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=222094a5d10667beb859731f1bb3a492, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,180 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628326180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628326180"}]},"ts":"1689628326180"} 2023-07-17 21:12:06,180 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628326180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628326180"}]},"ts":"1689628326180"} 2023-07-17 21:12:06,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 10054615cd2d344cf28086e9004b505b, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:12:06,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 222094a5d10667beb859731f1bb3a492, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:06,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:06,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:06,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:06,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 222094a5d10667beb859731f1bb3a492, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:12:06,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10054615cd2d344cf28086e9004b505b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:12:06,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. service=AccessControlService 2023-07-17 21:12:06,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. service=AccessControlService 2023-07-17 21:12:06,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:06,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,362 INFO [StoreOpener-222094a5d10667beb859731f1bb3a492-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,363 INFO [StoreOpener-10054615cd2d344cf28086e9004b505b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,365 DEBUG [StoreOpener-222094a5d10667beb859731f1bb3a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf 2023-07-17 21:12:06,365 DEBUG [StoreOpener-10054615cd2d344cf28086e9004b505b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf 2023-07-17 21:12:06,365 DEBUG [StoreOpener-222094a5d10667beb859731f1bb3a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf 2023-07-17 21:12:06,365 DEBUG [StoreOpener-10054615cd2d344cf28086e9004b505b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf 2023-07-17 21:12:06,367 INFO [StoreOpener-10054615cd2d344cf28086e9004b505b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10054615cd2d344cf28086e9004b505b columnFamilyName cf 2023-07-17 21:12:06,367 INFO [StoreOpener-222094a5d10667beb859731f1bb3a492-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 222094a5d10667beb859731f1bb3a492 columnFamilyName cf 2023-07-17 21:12:06,368 INFO [StoreOpener-222094a5d10667beb859731f1bb3a492-1] regionserver.HStore(310): Store=222094a5d10667beb859731f1bb3a492/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:06,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,371 INFO [StoreOpener-10054615cd2d344cf28086e9004b505b-1] regionserver.HStore(310): Store=10054615cd2d344cf28086e9004b505b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:06,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:06,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:06,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:06,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:06,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 222094a5d10667beb859731f1bb3a492; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62708828, jitterRate=-0.06556564569473267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:06,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 222094a5d10667beb859731f1bb3a492: 2023-07-17 21:12:06,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492., pid=61, masterSystemTime=1689628326338 2023-07-17 21:12:06,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 10054615cd2d344cf28086e9004b505b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72876651, jitterRate=0.08594672381877899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:06,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 10054615cd2d344cf28086e9004b505b: 2023-07-17 21:12:06,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b., pid=60, masterSystemTime=1689628326337 2023-07-17 21:12:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:06,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:06,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:06,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:06,395 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=222094a5d10667beb859731f1bb3a492, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,396 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326395"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628326395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628326395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628326395"}]},"ts":"1689628326395"} 2023-07-17 21:12:06,396 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=10054615cd2d344cf28086e9004b505b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,396 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628326396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628326396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628326396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628326396"}]},"ts":"1689628326396"} 2023-07-17 21:12:06,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-17 21:12:06,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-17 21:12:06,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 222094a5d10667beb859731f1bb3a492, server=jenkins-hbase4.apache.org,34535,1689628244104 in 215 msec 2023-07-17 21:12:06,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 10054615cd2d344cf28086e9004b505b, server=jenkins-hbase4.apache.org,42831,1689628244018 in 217 msec 2023-07-17 21:12:06,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, ASSIGN in 390 msec 2023-07-17 21:12:06,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-17 21:12:06,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, ASSIGN in 390 msec 2023-07-17 21:12:06,413 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:06,413 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628326413"}]},"ts":"1689628326413"} 2023-07-17 21:12:06,415 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 21:12:06,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:06,418 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 21:12:06,420 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 21:12:06,421 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,421 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,421 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,421 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:06,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:06,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 527 msec 2023-07-17 21:12:06,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 21:12:06,511 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 21:12:06,511 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-17 21:12:06,511 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:06,520 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-17 21:12:06,520 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:06,521 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-17 21:12:06,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:06,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628326537 (current time:1689628326537). 2023-07-17 21:12:06,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:06,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x6449b12d to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:06,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5078210, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:06,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:06,571 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:06,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6449b12d to 127.0.0.1:53065 2023-07-17 21:12:06,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:06,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x04ed9c6f to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:06,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d849506, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:06,679 DEBUG [hconnection-0x142a85a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:06,680 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:06,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:06,689 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:06,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04ed9c6f to 127.0.0.1:53065 2023-07-17 21:12:06,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:06,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 21:12:06,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:06,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:06,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:06,695 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:06,696 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689628926696 2023-07-17 21:12:06,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:06,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,698 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:06,698 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:06,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:06,699 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:06,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 21:12:06,702 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:06,703 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689628926703 2023-07-17 21:12:06,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,729 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 21:12:06,729 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:06,731 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 21:12:06,731 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 21:12:06,732 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,732 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:06,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:06,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:06,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:06,734 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:06,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:06,734 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,735 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,735 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,736 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,736 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,736 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:06,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,743 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:06,743 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:06,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,745 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:06,747 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:06,747 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:06,747 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:06,747 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:06,749 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:06,749 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:06,749 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:06,749 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:06,751 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,751 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,752 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,752 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:06,753 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:06,753 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:06,753 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,753 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d7fe0a[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:06,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:06,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d7fe0a[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:06,757 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 21:12:06,757 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,762 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,762 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,763 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:06,763 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:06,763 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,763 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:06,763 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:06,763 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:06,763 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. started... 2023-07-17 21:12:06,763 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,763 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:06,764 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,765 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:06,765 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:06,765 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:06,765 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10054615cd2d344cf28086e9004b505b: 2023-07-17 21:12:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,766 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. started... 2023-07-17 21:12:06,766 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:06,766 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:06,766 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:06,766 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,768 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:06,768 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:06,772 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 222094a5d10667beb859731f1bb3a492: 2023-07-17 21:12:06,772 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,772 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:06,772 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:06,773 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:06,773 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:06,773 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:06,806 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:06,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:06,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:06,808 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:06,859 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. completed. 2023-07-17 21:12:06,859 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:06,859 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:06,859 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:06,859 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,859 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:06,859 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:06,861 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. completed. 2023-07-17 21:12:06,861 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:06,861 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:06,861 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:06,861 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,861 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:06,861 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:06,862 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:06,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:06,862 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:06,862 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:06,862 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:06,864 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:06,864 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,864 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:06,865 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:06,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:06,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 21:12:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:12:06,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 21:12:06,876 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 21:12:06,876 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:06,876 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:06,876 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,876 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:06,879 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:06,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,881 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:06,882 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,882 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,883 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:06,885 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,885 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,885 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:06,892 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:06,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:06,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:06,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:06,892 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,893 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,893 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:06,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:06,893 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:06,893 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:06,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:06,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:06,893 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:06,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:06,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:06,909 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:06,909 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:06,909 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,910 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:06,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:06,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-17 21:12:07,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,008 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:07,009 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:07,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 21:12:07,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689628326696Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628326893 (+197 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628326893Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628326936 (+43 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689628326996 (+60 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689628327130 (+134 ms) 2023-07-17 21:12:07,138 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:07,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 441 msec 2023-07-17 21:12:07,310 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:07,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42831] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:07,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:07,325 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,325 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:07,325 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:07,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:07,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628327337 (current time:1689628327337). 2023-07-17 21:12:07,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:07,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x2df91df2 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:07,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e068d9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:07,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:07,393 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:07,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2df91df2 to 127.0.0.1:53065 2023-07-17 21:12:07,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:07,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x6c7857fc to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:07,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@98bc10c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:07,579 DEBUG [hconnection-0x23cbe7fa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:07,583 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:07,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:07,590 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:07,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c7857fc to 127.0.0.1:53065 2023-07-17 21:12:07,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:07,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 21:12:07,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:07,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:07,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:07,598 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:07,599 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689628927599 2023-07-17 21:12:07,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 21:12:07,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:07,601 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 21:12:07,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 21:12:07,604 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:07,605 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:07,605 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:07,605 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689628927605 2023-07-17 21:12:07,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,654 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 21:12:07,654 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,656 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 21:12:07,656 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 21:12:07,656 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,656 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,705 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:07,707 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:07,755 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,755 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,755 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,755 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:07,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:07,756 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:07,756 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,756 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,756 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 21:12:07,757 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:07,757 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,759 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:07,759 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 21:12:07,759 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,759 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:07,760 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:07,760 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:07,759 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:07,760 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:07,761 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 21:12:07,761 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:07,760 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 21:12:07,761 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:07,761 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 21:12:07,801 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,801 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,801 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,832 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:07,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,832 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:07,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e4cc4c1[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:07,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:07,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:07,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 21:12:07,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e4cc4c1[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:07,837 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 21:12:07,837 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 21:12:07,863 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:07,863 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:07,864 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. started... 2023-07-17 21:12:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:07,863 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:07,864 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:07,864 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. started... 2023-07-17 21:12:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:07,864 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 10054615cd2d344cf28086e9004b505b 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 21:12:07,864 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 222094a5d10667beb859731f1bb3a492 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 21:12:07,865 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,865 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:07,880 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/.tmp/cf/1770b55eba8946ae8d90ae61437ec5ae 2023-07-17 21:12:07,881 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/.tmp/cf/39cc53e431954f8ca136ea308bf17cfe 2023-07-17 21:12:07,887 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/.tmp/cf/39cc53e431954f8ca136ea308bf17cfe as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf/39cc53e431954f8ca136ea308bf17cfe 2023-07-17 21:12:07,887 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/.tmp/cf/1770b55eba8946ae8d90ae61437ec5ae as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf/1770b55eba8946ae8d90ae61437ec5ae 2023-07-17 21:12:07,893 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf/1770b55eba8946ae8d90ae61437ec5ae, entries=3, sequenceid=6, filesize=5.0 K 2023-07-17 21:12:07,894 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 10054615cd2d344cf28086e9004b505b in 30ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:07,894 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 21:12:07,895 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10054615cd2d344cf28086e9004b505b: 2023-07-17 21:12:07,895 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,895 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:07,895 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf/1770b55eba8946ae8d90ae61437ec5ae] hfiles 2023-07-17 21:12:07,895 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf/1770b55eba8946ae8d90ae61437ec5ae for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,898 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf/39cc53e431954f8ca136ea308bf17cfe, entries=47, sequenceid=6, filesize=8.0 K 2023-07-17 21:12:07,899 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 222094a5d10667beb859731f1bb3a492 in 35ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:07,901 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 222094a5d10667beb859731f1bb3a492: 2023-07-17 21:12:07,901 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,901 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:07,901 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf/39cc53e431954f8ca136ea308bf17cfe] hfiles 2023-07-17 21:12:07,902 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf/39cc53e431954f8ca136ea308bf17cfe for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:07,907 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. completed. 2023-07-17 21:12:07,907 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:07,907 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:07,907 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:07,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:07,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:07,909 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:07,914 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. completed. 2023-07-17 21:12:07,914 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 21:12:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:07,940 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:07,940 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:07,940 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:08,001 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:08,001 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,001 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,001 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:08,047 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,047 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 21:12:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 21:12:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:08,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 21:12:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:12:08,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 21:12:08,056 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 21:12:08,057 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:08,057 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:08,057 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,057 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:08,210 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:08,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:08,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:08,219 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 21:12:08,240 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,240 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,240 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,240 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,241 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,242 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,242 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,242 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,243 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,246 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:08,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:08,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:08,250 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,251 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:08,251 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:08,324 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,324 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,324 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,325 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,325 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,325 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:08,324 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,324 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:08,325 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:08,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-17 21:12:08,326 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,326 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:08,327 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,327 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,327 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:08,327 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:08,327 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:08,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,328 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,328 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 21:12:08,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,443 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:08,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689628327600Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328326 (+726 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328327 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328331 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689628328384 (+53 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689628328443 (+59 ms) 2023-07-17 21:12:08,446 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 21:12:08,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 845 msec 2023-07-17 21:12:08,720 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:08,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 21:12:08,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:08,749 DEBUG [Listener at jenkins-hbase4.apache.org/41521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:12:08,755 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:12:08,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 21:12:08,757 DEBUG [Listener at jenkins-hbase4.apache.org/41521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:12:08,761 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:12:08,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 21:12:08,762 DEBUG [Listener at jenkins-hbase4.apache.org/41521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 21:12:08,768 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 21:12:08,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42831] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 21:12:08,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:12:08,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:08,781 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:08,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 21:12:08,782 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:08,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:08,786 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a 2023-07-17 21:12:08,786 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:08,786 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a empty. 2023-07-17 21:12:08,786 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 empty. 2023-07-17 21:12:08,787 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a 2023-07-17 21:12:08,787 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:08,787 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 21:12:08,797 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:08,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1ed79f00e6d0a1e40ed5bdc44116fc54, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:08,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 391118b23d136509d06d29fbe662431a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:08,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:08,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 1ed79f00e6d0a1e40ed5bdc44116fc54, disabling compactions & flushes 2023-07-17 21:12:08,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:08,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:08,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 391118b23d136509d06d29fbe662431a, disabling compactions & flushes 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. after waiting 0 ms 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:08,808 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:08,808 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 1ed79f00e6d0a1e40ed5bdc44116fc54: 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. after waiting 0 ms 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:08,808 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:08,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 391118b23d136509d06d29fbe662431a: 2023-07-17 21:12:08,810 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:08,811 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628328811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628328811"}]},"ts":"1689628328811"} 2023-07-17 21:12:08,811 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628328811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628328811"}]},"ts":"1689628328811"} 2023-07-17 21:12:08,813 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:08,814 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:08,814 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628328814"}]},"ts":"1689628328814"} 2023-07-17 21:12:08,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 21:12:08,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:08,909 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:08,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:08,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:08,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:08,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:08,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, ASSIGN}] 2023-07-17 21:12:08,913 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, ASSIGN 2023-07-17 21:12:08,914 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, ASSIGN 2023-07-17 21:12:08,914 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42831,1689628244018; forceNewPlan=false, retain=false 2023-07-17 21:12:08,914 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:12:09,065 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:09,067 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=391118b23d136509d06d29fbe662431a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:09,067 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1ed79f00e6d0a1e40ed5bdc44116fc54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:09,067 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628329067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628329067"}]},"ts":"1689628329067"} 2023-07-17 21:12:09,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628329067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628329067"}]},"ts":"1689628329067"} 2023-07-17 21:12:09,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 391118b23d136509d06d29fbe662431a, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:09,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 1ed79f00e6d0a1e40ed5bdc44116fc54, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:12:09,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:09,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ed79f00e6d0a1e40ed5bdc44116fc54, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 21:12:09,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. service=AccessControlService 2023-07-17 21:12:09,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 391118b23d136509d06d29fbe662431a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. service=AccessControlService 2023-07-17 21:12:09,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:09,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:09,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,229 INFO [StoreOpener-1ed79f00e6d0a1e40ed5bdc44116fc54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,231 DEBUG [StoreOpener-1ed79f00e6d0a1e40ed5bdc44116fc54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf 2023-07-17 21:12:09,231 DEBUG [StoreOpener-1ed79f00e6d0a1e40ed5bdc44116fc54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf 2023-07-17 21:12:09,231 INFO [StoreOpener-1ed79f00e6d0a1e40ed5bdc44116fc54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ed79f00e6d0a1e40ed5bdc44116fc54 columnFamilyName cf 2023-07-17 21:12:09,232 INFO [StoreOpener-1ed79f00e6d0a1e40ed5bdc44116fc54-1] regionserver.HStore(310): Store=1ed79f00e6d0a1e40ed5bdc44116fc54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:09,236 INFO [StoreOpener-391118b23d136509d06d29fbe662431a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,238 DEBUG [StoreOpener-391118b23d136509d06d29fbe662431a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf 2023-07-17 21:12:09,238 DEBUG [StoreOpener-391118b23d136509d06d29fbe662431a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf 2023-07-17 21:12:09,239 INFO [StoreOpener-391118b23d136509d06d29fbe662431a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 391118b23d136509d06d29fbe662431a columnFamilyName cf 2023-07-17 21:12:09,239 INFO [StoreOpener-391118b23d136509d06d29fbe662431a-1] regionserver.HStore(310): Store=391118b23d136509d06d29fbe662431a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:09,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:09,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ed79f00e6d0a1e40ed5bdc44116fc54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59929341, jitterRate=-0.1069832295179367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:09,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ed79f00e6d0a1e40ed5bdc44116fc54: 2023-07-17 21:12:09,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54., pid=70, masterSystemTime=1689628329221 2023-07-17 21:12:09,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:09,250 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1ed79f00e6d0a1e40ed5bdc44116fc54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:09,250 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329250"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628329250"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628329250"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628329250"}]},"ts":"1689628329250"} 2023-07-17 21:12:09,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 391118b23d136509d06d29fbe662431a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61593609, jitterRate=-0.08218370378017426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:09,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 391118b23d136509d06d29fbe662431a: 2023-07-17 21:12:09,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a., pid=69, masterSystemTime=1689628329221 2023-07-17 21:12:09,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-17 21:12:09,255 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=391118b23d136509d06d29fbe662431a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:09,255 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329255"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628329255"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628329255"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628329255"}]},"ts":"1689628329255"} 2023-07-17 21:12:09,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 1ed79f00e6d0a1e40ed5bdc44116fc54, server=jenkins-hbase4.apache.org,42831,1689628244018 in 182 msec 2023-07-17 21:12:09,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, ASSIGN in 344 msec 2023-07-17 21:12:09,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-17 21:12:09,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 391118b23d136509d06d29fbe662431a, server=jenkins-hbase4.apache.org,34535,1689628244104 in 188 msec 2023-07-17 21:12:09,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-17 21:12:09,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, ASSIGN in 348 msec 2023-07-17 21:12:09,262 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:09,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628329262"}]},"ts":"1689628329262"} 2023-07-17 21:12:09,263 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 21:12:09,268 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:09,269 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 21:12:09,271 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 21:12:09,272 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:09,272 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:09,272 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:09,272 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:09,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:09,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 503 msec 2023-07-17 21:12:09,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 21:12:09,387 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 21:12:09,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 391118b23d136509d06d29fbe662431a, 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[391118b23d136509d06d29fbe662431a, 1ed79f00e6d0a1e40ed5bdc44116fc54], force=true 2023-07-17 21:12:09,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[391118b23d136509d06d29fbe662431a, 1ed79f00e6d0a1e40ed5bdc44116fc54], force=true 2023-07-17 21:12:09,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[391118b23d136509d06d29fbe662431a, 1ed79f00e6d0a1e40ed5bdc44116fc54], force=true 2023-07-17 21:12:09,426 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[391118b23d136509d06d29fbe662431a, 1ed79f00e6d0a1e40ed5bdc44116fc54], force=true 2023-07-17 21:12:09,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:09,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, UNASSIGN}] 2023-07-17 21:12:09,461 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, UNASSIGN 2023-07-17 21:12:09,462 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, UNASSIGN 2023-07-17 21:12:09,463 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=391118b23d136509d06d29fbe662431a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:09,463 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1ed79f00e6d0a1e40ed5bdc44116fc54, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:09,464 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628329463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628329463"}]},"ts":"1689628329463"} 2023-07-17 21:12:09,464 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628329463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628329463"}]},"ts":"1689628329463"} 2023-07-17 21:12:09,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 391118b23d136509d06d29fbe662431a, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:09,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 1ed79f00e6d0a1e40ed5bdc44116fc54, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:12:09,516 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0004_000001 (auth:SIMPLE) 2023-07-17 21:12:09,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:09,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 391118b23d136509d06d29fbe662431a, disabling compactions & flushes 2023-07-17 21:12:09,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. after waiting 0 ms 2023-07-17 21:12:09,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 391118b23d136509d06d29fbe662431a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 21:12:09,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ed79f00e6d0a1e40ed5bdc44116fc54, disabling compactions & flushes 2023-07-17 21:12:09,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. after waiting 0 ms 2023-07-17 21:12:09,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1ed79f00e6d0a1e40ed5bdc44116fc54 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 21:12:09,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/.tmp/cf/ba34298a944f4bebb1b198fc9a290e83 2023-07-17 21:12:09,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/.tmp/cf/ba34298a944f4bebb1b198fc9a290e83 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf/ba34298a944f4bebb1b198fc9a290e83 2023-07-17 21:12:09,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/.tmp/cf/c3520f19f1d341f6b161e652d35808c3 2023-07-17 21:12:09,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf/ba34298a944f4bebb1b198fc9a290e83, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 21:12:09,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 391118b23d136509d06d29fbe662431a in 33ms, sequenceid=5, compaction requested=false 2023-07-17 21:12:09,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 21:12:09,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/.tmp/cf/c3520f19f1d341f6b161e652d35808c3 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf/c3520f19f1d341f6b161e652d35808c3 2023-07-17 21:12:09,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf/c3520f19f1d341f6b161e652d35808c3, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 21:12:09,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1ed79f00e6d0a1e40ed5bdc44116fc54 in 25ms, sequenceid=5, compaction requested=false 2023-07-17 21:12:09,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 21:12:09,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:09,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a. 2023-07-17 21:12:09,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 391118b23d136509d06d29fbe662431a: 2023-07-17 21:12:09,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 21:12:09,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 391118b23d136509d06d29fbe662431a 2023-07-17 21:12:09,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:09,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54. 2023-07-17 21:12:09,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=391118b23d136509d06d29fbe662431a, regionState=CLOSED 2023-07-17 21:12:09,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ed79f00e6d0a1e40ed5bdc44116fc54: 2023-07-17 21:12:09,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329687"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628329687"}]},"ts":"1689628329687"} 2023-07-17 21:12:09,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:09,690 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1ed79f00e6d0a1e40ed5bdc44116fc54, regionState=CLOSED 2023-07-17 21:12:09,690 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689628329690"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628329690"}]},"ts":"1689628329690"} 2023-07-17 21:12:09,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-17 21:12:09,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 391118b23d136509d06d29fbe662431a, server=jenkins-hbase4.apache.org,34535,1689628244104 in 222 msec 2023-07-17 21:12:09,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=391118b23d136509d06d29fbe662431a, UNASSIGN in 236 msec 2023-07-17 21:12:09,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-17 21:12:09,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 1ed79f00e6d0a1e40ed5bdc44116fc54, server=jenkins-hbase4.apache.org,42831,1689628244018 in 213 msec 2023-07-17 21:12:09,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-17 21:12:09,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1ed79f00e6d0a1e40ed5bdc44116fc54, UNASSIGN in 233 msec 2023-07-17 21:12:09,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:09,756 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 21:12:09,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328770.391118b23d136509d06d29fbe662431a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:09,759 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689628328770.1ed79f00e6d0a1e40ed5bdc44116fc54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:09,759 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:09,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, ASSIGN}] 2023-07-17 21:12:09,815 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, ASSIGN 2023-07-17 21:12:09,815 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:12:09,966 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 21:12:09,968 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d7aa1f11efc136dfde29b20895bcafe7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:09,968 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628329967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628329967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628329967"}]},"ts":"1689628329967"} 2023-07-17 21:12:09,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure d7aa1f11efc136dfde29b20895bcafe7, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:10,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:10,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:10,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7aa1f11efc136dfde29b20895bcafe7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.', STARTKEY => '', ENDKEY => ''} 2023-07-17 21:12:10,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. service=AccessControlService 2023-07-17 21:12:10,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:10,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:10,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/.regioninfo 2023-07-17 21:12:10,136 INFO [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,137 DEBUG [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf 2023-07-17 21:12:10,137 DEBUG [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf 2023-07-17 21:12:10,138 INFO [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7aa1f11efc136dfde29b20895bcafe7 columnFamilyName cf 2023-07-17 21:12:10,165 DEBUG [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] regionserver.HStore(539): loaded hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/ba34298a944f4bebb1b198fc9a290e83.391118b23d136509d06d29fbe662431a->hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf/ba34298a944f4bebb1b198fc9a290e83-top 2023-07-17 21:12:10,170 DEBUG [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] regionserver.HStore(539): loaded hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/c3520f19f1d341f6b161e652d35808c3.1ed79f00e6d0a1e40ed5bdc44116fc54->hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf/c3520f19f1d341f6b161e652d35808c3-top 2023-07-17 21:12:10,171 INFO [StoreOpener-d7aa1f11efc136dfde29b20895bcafe7-1] regionserver.HStore(310): Store=d7aa1f11efc136dfde29b20895bcafe7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:10,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:10,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7aa1f11efc136dfde29b20895bcafe7; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60343434, jitterRate=-0.10081276297569275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:10,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7aa1f11efc136dfde29b20895bcafe7: 2023-07-17 21:12:10,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7., pid=77, masterSystemTime=1689628330121 2023-07-17 21:12:10,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.,because compaction is disabled. 2023-07-17 21:12:10,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:10,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:10,180 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d7aa1f11efc136dfde29b20895bcafe7, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,180 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628330180"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628330180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628330180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628330180"}]},"ts":"1689628330180"} 2023-07-17 21:12:10,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 21:12:10,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure d7aa1f11efc136dfde29b20895bcafe7, server=jenkins-hbase4.apache.org,34535,1689628244104 in 213 msec 2023-07-17 21:12:10,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 21:12:10,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, ASSIGN in 369 msec 2023-07-17 21:12:10,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[391118b23d136509d06d29fbe662431a, 1ed79f00e6d0a1e40ed5bdc44116fc54], force=true in 768 msec 2023-07-17 21:12:10,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 21:12:10,534 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 21:12:10,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 21:12:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628330535 (current time:1689628330535). 2023-07-17 21:12:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:10,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x72c9a92f to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:10,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e591f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:10,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:10,547 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:10,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72c9a92f to 127.0.0.1:53065 2023-07-17 21:12:10,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:10,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x12583217 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:10,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2de761a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:10,571 DEBUG [hconnection-0x2b41e31e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:10,574 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:10,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:10,582 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:10,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12583217 to 127.0.0.1:53065 2023-07-17 21:12:10,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:10,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 21:12:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 21:12:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 21:12:10,589 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 21:12:10,589 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689628930589 2023-07-17 21:12:10,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 21:12:10,589 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,595 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:10,595 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:10,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 21:12:10,596 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 21:12:10,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-17 21:12:10,607 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 21:12:10,607 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689628930607 2023-07-17 21:12:10,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,665 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 21:12:10,665 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:10,672 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 21:12:10,673 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 21:12:10,673 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,673 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,675 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:10,675 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:10,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:10,675 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:10,675 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:10,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:10,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,676 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,676 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 21:12:10,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 21:12:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 21:12:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:10,688 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 21:12:10,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,691 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 21:12:10,689 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 21:12:10,688 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 21:12:10,691 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 21:12:10,691 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 21:12:10,691 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:10,691 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 21:12:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 21:12:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 21:12:10,692 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 21:12:10,695 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:10,696 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:10,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:10,696 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 21:12:10,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:10,697 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:10,697 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:10,697 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,697 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:10,697 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,697 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:10,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:10,698 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,698 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:10,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 21:12:10,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a954bb6[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:10,701 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 21:12:10,701 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 21:12:10,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,703 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 21:12:10,703 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:10,704 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:10,704 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:10,704 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:10,704 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. started... 2023-07-17 21:12:10,706 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d7aa1f11efc136dfde29b20895bcafe7: 2023-07-17 21:12:10,706 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 21:12:10,706 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,706 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:10,706 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:10,706 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 21:12:10,706 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/ba34298a944f4bebb1b198fc9a290e83.391118b23d136509d06d29fbe662431a->hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf/ba34298a944f4bebb1b198fc9a290e83-top, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/c3520f19f1d341f6b161e652d35808c3.1ed79f00e6d0a1e40ed5bdc44116fc54->hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf/c3520f19f1d341f6b161e652d35808c3-top] hfiles 2023-07-17 21:12:10,706 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/ba34298a944f4bebb1b198fc9a290e83.391118b23d136509d06d29fbe662431a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,708 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 21:12:10,708 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:10,708 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 21:12:10,713 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/c3520f19f1d341f6b161e652d35808c3.1ed79f00e6d0a1e40ed5bdc44116fc54 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,730 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. completed. 2023-07-17 21:12:10,731 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:10,731 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:10,731 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:10,731 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,731 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 21:12:10,731 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:10,738 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,738 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 21:12:10,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:10,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:10,738 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:10,738 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 21:12:10,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:10,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:10,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:10,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:10,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 21:12:10,742 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 21:12:10,742 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:10,742 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:10,742 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,742 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:10,744 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:10,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:10,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,744 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:10,744 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:10,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,745 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:10,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:10,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:10,745 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:10,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:10,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:10,745 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:10,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:10,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,746 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:10,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:10,755 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,756 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,756 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:10,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:10,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:10,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:10,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:10,760 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,761 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:10,761 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:10,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,761 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:10,761 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:10,761 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,761 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:10,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:10,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:10,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:10,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,761 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:10,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:10,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:10,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 21:12:10,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,817 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689628330590Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628330761 (+171 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628330761Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628330765 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689628330783 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689628330816 (+33 ms) 2023-07-17 21:12:10,819 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 21:12:10,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 225 msec 2023-07-17 21:12:10,897 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:10,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 21:12:10,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:10,899 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899 2023-07-17 21:12:10,899 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38145, tgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899, rawTgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:12:10,928 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:12:10,928 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_886730336_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:10,928 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 21:12:10,964 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:11,093 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:11,094 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:11,094 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:11,095 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:11,193 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:12,226 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-1992543650606984908.jar 2023-07-17 21:12:12,227 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,227 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,300 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-675951601094491405.jar 2023-07-17 21:12:12,301 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,301 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,301 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,302 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,302 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,302 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:12,303 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:12:12,303 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:12:12,304 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:12:12,304 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:12:12,304 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:12:12,305 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:12:12,306 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:12:12,306 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:12:12,307 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:12:12,308 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:12:12,308 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:12,309 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:12,310 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:12,310 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:12,311 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:12,312 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:12,313 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:12,928 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:12:12,931 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 21:12:12,933 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 21:12:13,010 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:13,010 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:13,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:18,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:21,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:25,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:26,232 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:12:26,243 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:12:26,275 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,275 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:12:26,275 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:12:26,276 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,276 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 21:12:26,276 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 21:12:26,276 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,277 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 21:12:26,277 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628330899/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 21:12:26,293 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 21:12:26,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628346303"}]},"ts":"1689628346303"} 2023-07-17 21:12:26,305 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 21:12:26,306 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 21:12:26,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, UNASSIGN}] 2023-07-17 21:12:26,312 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, UNASSIGN 2023-07-17 21:12:26,315 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d7aa1f11efc136dfde29b20895bcafe7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:26,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628346315"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628346315"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628346315"}]},"ts":"1689628346315"} 2023-07-17 21:12:26,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure d7aa1f11efc136dfde29b20895bcafe7, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:26,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 21:12:26,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:26,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7aa1f11efc136dfde29b20895bcafe7, disabling compactions & flushes 2023-07-17 21:12:26,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:26,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:26,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. after waiting 0 ms 2023-07-17 21:12:26,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:26,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 21:12:26,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:26,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7. 2023-07-17 21:12:26,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7aa1f11efc136dfde29b20895bcafe7: 2023-07-17 21:12:26,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:26,491 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d7aa1f11efc136dfde29b20895bcafe7, regionState=CLOSED 2023-07-17 21:12:26,491 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689628346491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628346491"}]},"ts":"1689628346491"} 2023-07-17 21:12:26,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 21:12:26,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure d7aa1f11efc136dfde29b20895bcafe7, server=jenkins-hbase4.apache.org,34535,1689628244104 in 175 msec 2023-07-17 21:12:26,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 21:12:26,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d7aa1f11efc136dfde29b20895bcafe7, UNASSIGN in 187 msec 2023-07-17 21:12:26,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628346500"}]},"ts":"1689628346500"} 2023-07-17 21:12:26,501 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 21:12:26,503 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 21:12:26,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 213 msec 2023-07-17 21:12:26,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 21:12:26,606 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 21:12:26,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,611 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,613 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,614 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,617 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,617 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,617 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,617 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:26,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:26,618 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:26,618 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a 2023-07-17 21:12:26,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:26,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 21:12:26,618 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:26,620 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,620 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:26,620 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,620 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/recovered.edits] 2023-07-17 21:12:26,621 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,621 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:26,621 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,621 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:26,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 21:12:26,621 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:26,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:26,622 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/recovered.edits] 2023-07-17 21:12:26,621 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/recovered.edits] 2023-07-17 21:12:26,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:26,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:26,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:26,633 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf/c3520f19f1d341f6b161e652d35808c3 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/cf/c3520f19f1d341f6b161e652d35808c3 2023-07-17 21:12:26,634 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf/ba34298a944f4bebb1b198fc9a290e83 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/cf/ba34298a944f4bebb1b198fc9a290e83 2023-07-17 21:12:26,639 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/ba34298a944f4bebb1b198fc9a290e83.391118b23d136509d06d29fbe662431a to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/ba34298a944f4bebb1b198fc9a290e83.391118b23d136509d06d29fbe662431a 2023-07-17 21:12:26,641 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/recovered.edits/8.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a/recovered.edits/8.seqid 2023-07-17 21:12:26,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/c3520f19f1d341f6b161e652d35808c3.1ed79f00e6d0a1e40ed5bdc44116fc54 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/cf/c3520f19f1d341f6b161e652d35808c3.1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:26,642 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/recovered.edits/8.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54/recovered.edits/8.seqid 2023-07-17 21:12:26,643 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/391118b23d136509d06d29fbe662431a 2023-07-17 21:12:26,643 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1ed79f00e6d0a1e40ed5bdc44116fc54 2023-07-17 21:12:26,646 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/recovered.edits/12.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7/recovered.edits/12.seqid 2023-07-17 21:12:26,649 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d7aa1f11efc136dfde29b20895bcafe7 2023-07-17 21:12:26,649 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 21:12:26,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,654 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 21:12:26,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 21:12:26,670 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,670 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 21:12:26,670 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628346670"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:26,673 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 21:12:26,673 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d7aa1f11efc136dfde29b20895bcafe7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689628328771.d7aa1f11efc136dfde29b20895bcafe7.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 21:12:26,673 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 21:12:26,673 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628346673"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:26,679 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 21:12:26,681 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:26,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 74 msec 2023-07-17 21:12:26,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 21:12:26,723 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 21:12:26,724 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:26,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:26,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:26,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 21:12:26,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628346730"}]},"ts":"1689628346730"} 2023-07-17 21:12:26,732 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 21:12:26,734 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 21:12:26,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, UNASSIGN}] 2023-07-17 21:12:26,736 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, UNASSIGN 2023-07-17 21:12:26,738 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, UNASSIGN 2023-07-17 21:12:26,740 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=222094a5d10667beb859731f1bb3a492, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:26,740 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628346740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628346740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628346740"}]},"ts":"1689628346740"} 2023-07-17 21:12:26,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=10054615cd2d344cf28086e9004b505b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:26,741 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628346740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628346740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628346740"}]},"ts":"1689628346740"} 2023-07-17 21:12:26,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 10054615cd2d344cf28086e9004b505b, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:12:26,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 222094a5d10667beb859731f1bb3a492, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:26,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 21:12:26,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:26,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 222094a5d10667beb859731f1bb3a492, disabling compactions & flushes 2023-07-17 21:12:26,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:26,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:26,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. after waiting 0 ms 2023-07-17 21:12:26,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:26,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 10054615cd2d344cf28086e9004b505b, disabling compactions & flushes 2023-07-17 21:12:26,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:26,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:26,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. after waiting 0 ms 2023-07-17 21:12:26,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:26,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:26,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:26,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:26,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492. 2023-07-17 21:12:26,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 222094a5d10667beb859731f1bb3a492: 2023-07-17 21:12:26,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:26,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b. 2023-07-17 21:12:26,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 10054615cd2d344cf28086e9004b505b: 2023-07-17 21:12:26,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:26,931 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=222094a5d10667beb859731f1bb3a492, regionState=CLOSED 2023-07-17 21:12:26,931 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628346931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628346931"}]},"ts":"1689628346931"} 2023-07-17 21:12:26,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:26,932 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=10054615cd2d344cf28086e9004b505b, regionState=CLOSED 2023-07-17 21:12:26,932 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689628346932"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628346932"}]},"ts":"1689628346932"} 2023-07-17 21:12:26,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-17 21:12:26,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 222094a5d10667beb859731f1bb3a492, server=jenkins-hbase4.apache.org,34535,1689628244104 in 194 msec 2023-07-17 21:12:26,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-17 21:12:26,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 10054615cd2d344cf28086e9004b505b, server=jenkins-hbase4.apache.org,42831,1689628244018 in 198 msec 2023-07-17 21:12:26,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=222094a5d10667beb859731f1bb3a492, UNASSIGN in 208 msec 2023-07-17 21:12:26,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-17 21:12:26,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=10054615cd2d344cf28086e9004b505b, UNASSIGN in 209 msec 2023-07-17 21:12:26,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628346947"}]},"ts":"1689628346947"} 2023-07-17 21:12:26,949 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 21:12:26,951 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 21:12:26,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 228 msec 2023-07-17 21:12:27,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 21:12:27,036 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 21:12:27,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,042 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,043 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,046 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,049 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,049 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,049 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 21:12:27,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:27,049 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:27,051 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 21:12:27,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 21:12:27,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,053 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,054 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,054 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/recovered.edits] 2023-07-17 21:12:27,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 21:12:27,055 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/recovered.edits] 2023-07-17 21:12:27,061 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf/39cc53e431954f8ca136ea308bf17cfe to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/cf/39cc53e431954f8ca136ea308bf17cfe 2023-07-17 21:12:27,061 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf/1770b55eba8946ae8d90ae61437ec5ae to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/cf/1770b55eba8946ae8d90ae61437ec5ae 2023-07-17 21:12:27,068 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492/recovered.edits/9.seqid 2023-07-17 21:12:27,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b/recovered.edits/9.seqid 2023-07-17 21:12:27,069 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/222094a5d10667beb859731f1bb3a492 2023-07-17 21:12:27,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/10054615cd2d344cf28086e9004b505b 2023-07-17 21:12:27,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 21:12:27,074 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,096 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 21:12:27,109 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 21:12:27,113 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,113 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 21:12:27,113 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628347113"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:27,113 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628347113"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:27,115 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:12:27,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 10054615cd2d344cf28086e9004b505b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689628325896.10054615cd2d344cf28086e9004b505b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 222094a5d10667beb859731f1bb3a492, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689628325896.222094a5d10667beb859731f1bb3a492.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:12:27,115 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 21:12:27,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628347115"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:27,118 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 21:12:27,121 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 84 msec 2023-07-17 21:12:27,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 21:12:27,156 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 21:12:27,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 21:12:27,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 21:12:27,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 21:12:27,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 21:12:27,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 21:12:27,242 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 749) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:33694 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:52556 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:43785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1112890076_1 at /127.0.0.1:55400 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:55428 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=588 (was 416) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=2625 (was 2948) 2023-07-17 21:12:27,243 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-17 21:12:27,275 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=588, ProcessCount=190, AvailableMemoryMB=2618 2023-07-17 21:12:27,275 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-17 21:12:27,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:12:27,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:27,282 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:27,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 21:12:27,283 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:27,288 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,288 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,289 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 empty. 2023-07-17 21:12:27,289 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 empty. 2023-07-17 21:12:27,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:27,290 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,290 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,290 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 21:12:27,335 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:27,337 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => af67984dbc520f79d7601039e8608342, NAME => 'testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:27,338 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe140adb36ccbd009a1f18f37adab092, NAME => 'testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:27,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:27,476 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:27,476 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fe140adb36ccbd009a1f18f37adab092, disabling compactions & flushes 2023-07-17 21:12:27,476 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,477 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,477 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. after waiting 0 ms 2023-07-17 21:12:27,477 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,477 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,477 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fe140adb36ccbd009a1f18f37adab092: 2023-07-17 21:12:27,493 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:27,493 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing af67984dbc520f79d7601039e8608342, disabling compactions & flushes 2023-07-17 21:12:27,493 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,493 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,493 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. after waiting 0 ms 2023-07-17 21:12:27,493 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,493 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,493 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for af67984dbc520f79d7601039e8608342: 2023-07-17 21:12:27,497 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:27,498 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628347498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628347498"}]},"ts":"1689628347498"} 2023-07-17 21:12:27,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628347498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628347498"}]},"ts":"1689628347498"} 2023-07-17 21:12:27,501 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:27,502 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:27,502 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628347502"}]},"ts":"1689628347502"} 2023-07-17 21:12:27,504 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 21:12:27,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:27,509 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:27,509 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:27,509 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:27,509 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:27,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, ASSIGN}] 2023-07-17 21:12:27,527 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, ASSIGN 2023-07-17 21:12:27,528 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:12:27,537 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, ASSIGN 2023-07-17 21:12:27,538 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36811,1689628244152; forceNewPlan=false, retain=false 2023-07-17 21:12:27,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:27,678 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:27,682 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=af67984dbc520f79d7601039e8608342, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:27,683 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628347682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628347682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628347682"}]},"ts":"1689628347682"} 2023-07-17 21:12:27,683 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fe140adb36ccbd009a1f18f37adab092, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:27,683 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628347683"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628347683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628347683"}]},"ts":"1689628347683"} 2023-07-17 21:12:27,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure fe140adb36ccbd009a1f18f37adab092, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:27,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure af67984dbc520f79d7601039e8608342, server=jenkins-hbase4.apache.org,36811,1689628244152}] 2023-07-17 21:12:27,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe140adb36ccbd009a1f18f37adab092, NAME => 'testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. service=AccessControlService 2023-07-17 21:12:27,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af67984dbc520f79d7601039e8608342, NAME => 'testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:12:27,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. service=AccessControlService 2023-07-17 21:12:27,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:27,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:27,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,853 INFO [StoreOpener-fe140adb36ccbd009a1f18f37adab092-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,854 INFO [StoreOpener-af67984dbc520f79d7601039e8608342-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,855 DEBUG [StoreOpener-fe140adb36ccbd009a1f18f37adab092-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf 2023-07-17 21:12:27,855 DEBUG [StoreOpener-fe140adb36ccbd009a1f18f37adab092-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf 2023-07-17 21:12:27,856 INFO [StoreOpener-fe140adb36ccbd009a1f18f37adab092-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe140adb36ccbd009a1f18f37adab092 columnFamilyName cf 2023-07-17 21:12:27,856 INFO [StoreOpener-fe140adb36ccbd009a1f18f37adab092-1] regionserver.HStore(310): Store=fe140adb36ccbd009a1f18f37adab092/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:27,857 DEBUG [StoreOpener-af67984dbc520f79d7601039e8608342-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf 2023-07-17 21:12:27,857 DEBUG [StoreOpener-af67984dbc520f79d7601039e8608342-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf 2023-07-17 21:12:27,857 INFO [StoreOpener-af67984dbc520f79d7601039e8608342-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af67984dbc520f79d7601039e8608342 columnFamilyName cf 2023-07-17 21:12:27,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,859 INFO [StoreOpener-af67984dbc520f79d7601039e8608342-1] regionserver.HStore(310): Store=af67984dbc520f79d7601039e8608342/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:27,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:27,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af67984dbc520f79d7601039e8608342 2023-07-17 21:12:27,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:27,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:27,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fe140adb36ccbd009a1f18f37adab092; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73386537, jitterRate=0.0935446172952652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:27,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fe140adb36ccbd009a1f18f37adab092: 2023-07-17 21:12:27,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af67984dbc520f79d7601039e8608342; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65827585, jitterRate=-0.01909254491329193}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:27,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af67984dbc520f79d7601039e8608342: 2023-07-17 21:12:27,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342., pid=94, masterSystemTime=1689628347842 2023-07-17 21:12:27,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092., pid=93, masterSystemTime=1689628347842 2023-07-17 21:12:27,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:27,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:27,873 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=af67984dbc520f79d7601039e8608342, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:27,874 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628347873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628347873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628347873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628347873"}]},"ts":"1689628347873"} 2023-07-17 21:12:27,874 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fe140adb36ccbd009a1f18f37adab092, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:27,874 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628347874"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628347874"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628347874"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628347874"}]},"ts":"1689628347874"} 2023-07-17 21:12:27,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-17 21:12:27,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure af67984dbc520f79d7601039e8608342, server=jenkins-hbase4.apache.org,36811,1689628244152 in 184 msec 2023-07-17 21:12:27,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-17 21:12:27,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure fe140adb36ccbd009a1f18f37adab092, server=jenkins-hbase4.apache.org,34535,1689628244104 in 190 msec 2023-07-17 21:12:27,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, ASSIGN in 369 msec 2023-07-17 21:12:27,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-17 21:12:27,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, ASSIGN in 370 msec 2023-07-17 21:12:27,886 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:27,886 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628347886"}]},"ts":"1689628347886"} 2023-07-17 21:12:27,887 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 21:12:27,898 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:27,899 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 21:12:27,904 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:12:27,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,907 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:27,909 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:27,909 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:27,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:27,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:27,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:27,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:27,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 634 msec 2023-07-17 21:12:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 21:12:27,937 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 21:12:27,937 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 21:12:27,937 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:27,943 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 21:12:27,943 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:27,943 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-17 21:12:27,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:27,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628347947 (current time:1689628347947). 2023-07-17 21:12:27,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:27,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x60abc698 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:27,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb840b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:27,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:27,972 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:27,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60abc698 to 127.0.0.1:53065 2023-07-17 21:12:27,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:27,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x4d7bd458 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:28,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73da5469, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:28,094 DEBUG [hconnection-0x2a3e3762-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:28,098 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:28,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:28,105 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:28,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d7bd458 to 127.0.0.1:53065 2023-07-17 21:12:28,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:28,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:12:28,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:28,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:28,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:28,111 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:28,112 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628948112 2023-07-17 21:12:28,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:28,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:28,114 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:28,114 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:28,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:28,117 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:28,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-17 21:12:28,128 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:28,129 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628948129 2023-07-17 21:12:28,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,170 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 21:12:28,170 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,171 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 21:12:28,171 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:12:28,211 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,211 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,214 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:28,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:28,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:28,215 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:28,217 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,217 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,217 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,217 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,219 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,219 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,220 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:28,220 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:28,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:28,219 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,223 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:28,222 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:28,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 21:12:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,225 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:28,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,232 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,237 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,238 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,238 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,241 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:28,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7949ea38[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:28,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7949ea38[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:28,261 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:12:28,261 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,271 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,271 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:28,272 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:28,272 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. started... 2023-07-17 21:12:28,272 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:28,273 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:28,273 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:28,275 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af67984dbc520f79d7601039e8608342: 2023-07-17 21:12:28,275 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,275 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. started... 2023-07-17 21:12:28,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,275 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,276 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:28,276 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:28,276 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:28,277 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:28,276 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe140adb36ccbd009a1f18f37adab092: 2023-07-17 21:12:28,276 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,277 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:28,277 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,277 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:28,277 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:28,277 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,277 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:28,279 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:28,279 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:28,279 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:28,313 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. completed. 2023-07-17 21:12:28,313 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:28,313 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. completed. 2023-07-17 21:12:28,313 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:28,313 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:28,317 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:28,319 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:28,317 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,317 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:28,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:12:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36811,1689628244152': 2023-07-17 21:12:28,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:12:28,331 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 21:12:28,332 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:28,332 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:28,332 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,332 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,335 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:28,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:28,340 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,341 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,342 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,344 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,344 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,345 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,349 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:28,349 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,351 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:28,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:28,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:28,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:28,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:28,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-17 21:12:28,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,416 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:28,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:28,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:28,417 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:28,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 21:12:28,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,503 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689628348112Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689628348352 (+240 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689628348352Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689628348372 (+20 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689628348393 (+21 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689628348503 (+110 ms) 2023-07-17 21:12:28,508 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:28,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 394 msec 2023-07-17 21:12:28,542 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 21:12:28,717 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:28,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:28,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:28,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36811] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:28,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:28,747 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:28,747 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:28,749 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:28,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:28,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628348780 (current time:1689628348780). 2023-07-17 21:12:28,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:28,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x6864026a to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:28,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33babd23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:28,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:28,814 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:28,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6864026a to 127.0.0.1:53065 2023-07-17 21:12:28,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:28,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x76858c8c to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:28,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e3ab764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:28,867 DEBUG [hconnection-0x580f4625-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:28,868 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:28,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:28,890 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:28,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76858c8c to 127.0.0.1:53065 2023-07-17 21:12:28,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:28,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 21:12:28,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:28,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:28,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:28,897 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:28,898 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689628948898 2023-07-17 21:12:28,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 21:12:28,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:28,901 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:28,901 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:28,903 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 21:12:28,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:28,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-17 21:12:28,906 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:28,906 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689628948906 2023-07-17 21:12:28,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,931 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 21:12:28,931 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,933 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 21:12:28,933 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 21:12:28,933 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,933 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,935 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,935 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,935 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,938 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 21:12:28,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 21:12:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 21:12:28,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 21:12:28,940 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,940 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,940 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,940 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:28,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,948 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:28,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,949 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:28,949 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:28,949 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:28,949 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,949 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 21:12:28,951 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:28,951 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:28,951 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:28,951 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:28,956 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 21:12:28,956 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 21:12:28,956 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 21:12:28,959 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,959 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,959 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,959 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,959 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,960 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:28,959 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,960 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,960 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:28,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,960 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,960 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:28,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57406cb5[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:28,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:28,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 21:12:28,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57406cb5[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:28,964 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 21:12:28,964 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:28,969 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:28,969 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:28,969 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:28,969 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 21:12:28,970 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:28,970 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:28,970 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:28,971 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:28,971 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:28,971 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. started... 2023-07-17 21:12:28,971 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. started... 2023-07-17 21:12:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:28,971 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af67984dbc520f79d7601039e8608342 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 21:12:28,973 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fe140adb36ccbd009a1f18f37adab092 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 21:12:29,001 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:29,002 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:29,019 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/.tmp/cf/792075f90f034c5c9b8292b3436d21d6 2023-07-17 21:12:29,029 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/.tmp/cf/eb5cafce22f34896a7f7505d38cb9e64 2023-07-17 21:12:29,029 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/.tmp/cf/792075f90f034c5c9b8292b3436d21d6 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf/792075f90f034c5c9b8292b3436d21d6 2023-07-17 21:12:29,041 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/.tmp/cf/eb5cafce22f34896a7f7505d38cb9e64 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf/eb5cafce22f34896a7f7505d38cb9e64 2023-07-17 21:12:29,042 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf/792075f90f034c5c9b8292b3436d21d6, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 21:12:29,043 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fe140adb36ccbd009a1f18f37adab092 in 72ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:29,045 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe140adb36ccbd009a1f18f37adab092: 2023-07-17 21:12:29,045 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,046 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:29,046 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf/792075f90f034c5c9b8292b3436d21d6] hfiles 2023-07-17 21:12:29,046 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf/792075f90f034c5c9b8292b3436d21d6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,054 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf/eb5cafce22f34896a7f7505d38cb9e64, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 21:12:29,055 INFO [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for af67984dbc520f79d7601039e8608342 in 84ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:29,055 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af67984dbc520f79d7601039e8608342: 2023-07-17 21:12:29,055 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,055 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:29,055 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf/eb5cafce22f34896a7f7505d38cb9e64] hfiles 2023-07-17 21:12:29,055 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf/eb5cafce22f34896a7f7505d38cb9e64 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,082 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. completed. 2023-07-17 21:12:29,083 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:29,086 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:29,089 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. completed. 2023-07-17 21:12:29,089 DEBUG [rs(jenkins-hbase4.apache.org,36811,1689628244152)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 21:12:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 21:12:29,090 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 21:12:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:29,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 21:12:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36811,1689628244152': 2023-07-17 21:12:29,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 21:12:29,098 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 21:12:29,098 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:29,098 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:29,098 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,098 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:29,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,102 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:29,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:29,103 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,104 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:29,104 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:29,106 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,106 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,107 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:29,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:29,112 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:29,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:29,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:29,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:29,114 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:29,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,112 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:29,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:29,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:29,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:29,114 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:29,114 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,115 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:29,115 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:29,115 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:29,115 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:29,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,206 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:29,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:29,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:29,208 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 21:12:29,508 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:29,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:29,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:29,509 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 21:12:29,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 21:12:29,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,651 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:29,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689628348898Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689628349114 (+216 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689628349114Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689628349125 (+11 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689628349161 (+36 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689628349650 (+489 ms) 2023-07-17 21:12:29,660 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 21:12:29,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 760 msec 2023-07-17 21:12:30,010 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:30,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 21:12:30,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:30,011 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011 2023-07-17 21:12:30,011 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38145, tgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011, rawTgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:12:30,041 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:12:30,041 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-146171493_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:30,041 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 21:12:30,047 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:30,087 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:30,088 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:30,088 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:30,088 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,089 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-3017865963014937877.jar 2023-07-17 21:12:31,089 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,090 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,188 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-2275455589350249647.jar 2023-07-17 21:12:31,189 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,190 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,190 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,191 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,191 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,192 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:31,192 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:12:31,193 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:12:31,193 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:12:31,194 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:12:31,194 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:12:31,195 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:12:31,195 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:12:31,196 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:12:31,196 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:12:31,197 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:12:31,197 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:31,198 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:31,199 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:31,199 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:31,199 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:31,200 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:31,201 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:31,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0005_000001 (auth:SIMPLE) 2023-07-17 21:12:32,121 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:32,258 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:12:32,263 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 21:12:32,361 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:32,361 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:32,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0006_000001 (auth:SIMPLE) 2023-07-17 21:12:38,731 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0006_000001 (auth:SIMPLE) 2023-07-17 21:12:41,708 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:12:41,709 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:12:41,718 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:41,718 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:12:41,719 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:12:41,719 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:41,719 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 21:12:41,719 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 21:12:41,720 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:41,720 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 21:12:41,720 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628350011/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 21:12:41,729 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 21:12:41,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 21:12:41,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:41,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628361734"}]},"ts":"1689628361734"} 2023-07-17 21:12:41,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 21:12:41,736 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 21:12:41,738 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 21:12:41,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, UNASSIGN}] 2023-07-17 21:12:41,740 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, UNASSIGN 2023-07-17 21:12:41,742 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, UNASSIGN 2023-07-17 21:12:41,744 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=af67984dbc520f79d7601039e8608342, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:41,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fe140adb36ccbd009a1f18f37adab092, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:41,744 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628361744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628361744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628361744"}]},"ts":"1689628361744"} 2023-07-17 21:12:41,744 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628361744"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628361744"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628361744"}]},"ts":"1689628361744"} 2023-07-17 21:12:41,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure af67984dbc520f79d7601039e8608342, server=jenkins-hbase4.apache.org,36811,1689628244152}] 2023-07-17 21:12:41,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure fe140adb36ccbd009a1f18f37adab092, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:41,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 21:12:41,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af67984dbc520f79d7601039e8608342 2023-07-17 21:12:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af67984dbc520f79d7601039e8608342, disabling compactions & flushes 2023-07-17 21:12:41,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. after waiting 0 ms 2023-07-17 21:12:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:41,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fe140adb36ccbd009a1f18f37adab092, disabling compactions & flushes 2023-07-17 21:12:41,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:41,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. after waiting 0 ms 2023-07-17 21:12:41,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:41,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:41,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:41,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342. 2023-07-17 21:12:41,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:12:41,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af67984dbc520f79d7601039e8608342: 2023-07-17 21:12:41,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af67984dbc520f79d7601039e8608342 2023-07-17 21:12:41,995 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=af67984dbc520f79d7601039e8608342, regionState=CLOSED 2023-07-17 21:12:41,995 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628361995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628361995"}]},"ts":"1689628361995"} 2023-07-17 21:12:41,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:12:42,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092. 2023-07-17 21:12:42,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fe140adb36ccbd009a1f18f37adab092: 2023-07-17 21:12:42,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:42,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fe140adb36ccbd009a1f18f37adab092, regionState=CLOSED 2023-07-17 21:12:42,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689628362005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628362005"}]},"ts":"1689628362005"} 2023-07-17 21:12:42,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-17 21:12:42,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure af67984dbc520f79d7601039e8608342, server=jenkins-hbase4.apache.org,36811,1689628244152 in 259 msec 2023-07-17 21:12:42,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-17 21:12:42,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=af67984dbc520f79d7601039e8608342, UNASSIGN in 272 msec 2023-07-17 21:12:42,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure fe140adb36ccbd009a1f18f37adab092, server=jenkins-hbase4.apache.org,34535,1689628244104 in 263 msec 2023-07-17 21:12:42,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-17 21:12:42,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe140adb36ccbd009a1f18f37adab092, UNASSIGN in 275 msec 2023-07-17 21:12:42,018 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628362018"}]},"ts":"1689628362018"} 2023-07-17 21:12:42,019 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 21:12:42,021 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 21:12:42,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 293 msec 2023-07-17 21:12:42,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 21:12:42,039 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 21:12:42,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,047 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,049 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,052 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,055 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,056 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,056 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,056 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:42,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:42,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:42,057 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 21:12:42,057 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,058 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:42,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 21:12:42,066 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 2023-07-17 21:12:42,066 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:42,069 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/recovered.edits] 2023-07-17 21:12:42,080 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/recovered.edits] 2023-07-17 21:12:42,083 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf/792075f90f034c5c9b8292b3436d21d6 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/cf/792075f90f034c5c9b8292b3436d21d6 2023-07-17 21:12:42,087 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092/recovered.edits/9.seqid 2023-07-17 21:12:42,089 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe140adb36ccbd009a1f18f37adab092 2023-07-17 21:12:42,094 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf/eb5cafce22f34896a7f7505d38cb9e64 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/cf/eb5cafce22f34896a7f7505d38cb9e64 2023-07-17 21:12:42,099 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342/recovered.edits/9.seqid 2023-07-17 21:12:42,099 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testEmptyExportFileSystemState/af67984dbc520f79d7601039e8608342 2023-07-17 21:12:42,099 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 21:12:42,103 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,112 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 21:12:42,126 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 21:12:42,128 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,128 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 21:12:42,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628362128"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:42,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628362128"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:42,153 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:12:42,153 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => af67984dbc520f79d7601039e8608342, NAME => 'testtb-testEmptyExportFileSystemState,,1689628347277.af67984dbc520f79d7601039e8608342.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fe140adb36ccbd009a1f18f37adab092, NAME => 'testtb-testEmptyExportFileSystemState,1,1689628347277.fe140adb36ccbd009a1f18f37adab092.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:12:42,154 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 21:12:42,154 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628362154"}]},"ts":"9223372036854775807"} 2023-07-17 21:12:42,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 21:12:42,169 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 21:12:42,172 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 21:12:42,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 132 msec 2023-07-17 21:12:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 21:12:42,362 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 21:12:42,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 21:12:42,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:42,387 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 21:12:42,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 21:12:42,430 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1570816286_1 at /127.0.0.1:37754 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:41157 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:41521 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1570816286_1 at /127.0.0.1:36982 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:49046 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:49092 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:50930 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4601 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:33299 from appattempt_1689628253208_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=908 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=695 (was 588) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 190), AvailableMemoryMB=1912 (was 2618) 2023-07-17 21:12:42,430 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 21:12:42,460 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=695, ProcessCount=184, AvailableMemoryMB=1908 2023-07-17 21:12:42,461 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 21:12:42,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 21:12:42,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:42,469 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 21:12:42,470 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 21:12:42,470 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 21:12:42,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:42,473 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:42,473 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:42,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 empty. 2023-07-17 21:12:42,475 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 empty. 2023-07-17 21:12:42,475 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:42,477 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:42,477 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 21:12:42,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:42,590 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 21:12:42,592 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => f59b71d457583210793ad5a2c3fefac0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:42,615 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => cbf2d6524cc0445935f42b9459fb3ce2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp 2023-07-17 21:12:42,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:42,741 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing f59b71d457583210793ad5a2c3fefac0, disabling compactions & flushes 2023-07-17 21:12:42,741 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:42,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:42,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. after waiting 0 ms 2023-07-17 21:12:42,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:42,742 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:42,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for f59b71d457583210793ad5a2c3fefac0: 2023-07-17 21:12:42,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:42,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing cbf2d6524cc0445935f42b9459fb3ce2, disabling compactions & flushes 2023-07-17 21:12:42,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:42,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:42,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. after waiting 0 ms 2023-07-17 21:12:42,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:42,756 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:42,756 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for cbf2d6524cc0445935f42b9459fb3ce2: 2023-07-17 21:12:42,764 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 21:12:42,766 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628362766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628362766"}]},"ts":"1689628362766"} 2023-07-17 21:12:42,766 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628362766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628362766"}]},"ts":"1689628362766"} 2023-07-17 21:12:42,780 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 21:12:42,781 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 21:12:42,782 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628362782"}]},"ts":"1689628362782"} 2023-07-17 21:12:42,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:42,784 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 21:12:42,788 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 21:12:42,790 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 21:12:42,790 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 21:12:42,790 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 21:12:42,790 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 21:12:42,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, ASSIGN}] 2023-07-17 21:12:42,797 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, ASSIGN 2023-07-17 21:12:42,798 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, ASSIGN 2023-07-17 21:12:42,799 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34535,1689628244104; forceNewPlan=false, retain=false 2023-07-17 21:12:42,799 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42831,1689628244018; forceNewPlan=false, retain=false 2023-07-17 21:12:42,949 INFO [jenkins-hbase4:38665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 21:12:42,953 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=cbf2d6524cc0445935f42b9459fb3ce2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:42,953 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f59b71d457583210793ad5a2c3fefac0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:42,953 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628362953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628362953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628362953"}]},"ts":"1689628362953"} 2023-07-17 21:12:42,953 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628362953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628362953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628362953"}]},"ts":"1689628362953"} 2023-07-17 21:12:42,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure cbf2d6524cc0445935f42b9459fb3ce2, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:12:42,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure f59b71d457583210793ad5a2c3fefac0, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:12:43,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:43,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:43,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cbf2d6524cc0445935f42b9459fb3ce2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 21:12:43,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f59b71d457583210793ad5a2c3fefac0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. service=AccessControlService 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. service=AccessControlService 2023-07-17 21:12:43,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:43,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,117 INFO [StoreOpener-f59b71d457583210793ad5a2c3fefac0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,117 INFO [StoreOpener-cbf2d6524cc0445935f42b9459fb3ce2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,118 DEBUG [StoreOpener-f59b71d457583210793ad5a2c3fefac0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf 2023-07-17 21:12:43,118 DEBUG [StoreOpener-f59b71d457583210793ad5a2c3fefac0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf 2023-07-17 21:12:43,118 DEBUG [StoreOpener-cbf2d6524cc0445935f42b9459fb3ce2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf 2023-07-17 21:12:43,118 DEBUG [StoreOpener-cbf2d6524cc0445935f42b9459fb3ce2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf 2023-07-17 21:12:43,119 INFO [StoreOpener-f59b71d457583210793ad5a2c3fefac0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f59b71d457583210793ad5a2c3fefac0 columnFamilyName cf 2023-07-17 21:12:43,119 INFO [StoreOpener-cbf2d6524cc0445935f42b9459fb3ce2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbf2d6524cc0445935f42b9459fb3ce2 columnFamilyName cf 2023-07-17 21:12:43,119 INFO [StoreOpener-f59b71d457583210793ad5a2c3fefac0-1] regionserver.HStore(310): Store=f59b71d457583210793ad5a2c3fefac0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:43,119 INFO [StoreOpener-cbf2d6524cc0445935f42b9459fb3ce2-1] regionserver.HStore(310): Store=cbf2d6524cc0445935f42b9459fb3ce2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 21:12:43,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:12:43,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:12:43,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:43,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 21:12:43,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cbf2d6524cc0445935f42b9459fb3ce2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62692633, jitterRate=-0.06580697000026703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:43,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cbf2d6524cc0445935f42b9459fb3ce2: 2023-07-17 21:12:43,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f59b71d457583210793ad5a2c3fefac0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58877040, jitterRate=-0.12266373634338379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 21:12:43,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f59b71d457583210793ad5a2c3fefac0: 2023-07-17 21:12:43,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0., pid=109, masterSystemTime=1689628363108 2023-07-17 21:12:43,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2., pid=108, masterSystemTime=1689628363108 2023-07-17 21:12:43,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:43,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:43,139 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f59b71d457583210793ad5a2c3fefac0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:43,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:43,139 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628363138"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628363138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628363138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628363138"}]},"ts":"1689628363138"} 2023-07-17 21:12:43,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=cbf2d6524cc0445935f42b9459fb3ce2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628363139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689628363139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689628363139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689628363139"}]},"ts":"1689628363139"} 2023-07-17 21:12:43,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-17 21:12:43,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure f59b71d457583210793ad5a2c3fefac0, server=jenkins-hbase4.apache.org,42831,1689628244018 in 184 msec 2023-07-17 21:12:43,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, ASSIGN in 351 msec 2023-07-17 21:12:43,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-17 21:12:43,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure cbf2d6524cc0445935f42b9459fb3ce2, server=jenkins-hbase4.apache.org,34535,1689628244104 in 187 msec 2023-07-17 21:12:43,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-17 21:12:43,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, ASSIGN in 353 msec 2023-07-17 21:12:43,146 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 21:12:43,146 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628363146"}]},"ts":"1689628363146"} 2023-07-17 21:12:43,147 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 21:12:43,150 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 21:12:43,150 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 21:12:43,152 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 21:12:43,153 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:43,153 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:43,153 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:43,153 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:12:43,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:43,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:43,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:43,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 21:12:43,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 691 msec 2023-07-17 21:12:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 21:12:43,586 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 21:12:43,586 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-17 21:12:43,586 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:43,590 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-17 21:12:43,590 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:43,590 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-17 21:12:43,598 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:43,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628363598 (current time:1689628363598). 2023-07-17 21:12:43,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:43,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x0cda9c90 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:43,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e6263b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:43,620 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:43,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cda9c90 to 127.0.0.1:53065 2023-07-17 21:12:43,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:43,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x4fb80c98 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:43,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17de37e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:43,727 DEBUG [hconnection-0x1a2c996f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:43,731 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:43,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:43,738 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:43,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fb80c98 to 127.0.0.1:53065 2023-07-17 21:12:43,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:43,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 21:12:43,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:43,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:43,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:43,744 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:43,745 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689628963745 2023-07-17 21:12:43,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:43,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,746 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:43,747 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:43,748 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:43,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:43,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-17 21:12:43,750 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:43,750 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689628963750 2023-07-17 21:12:43,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,769 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 21:12:43,769 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:43,771 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 21:12:43,771 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 21:12:43,772 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,772 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,775 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:43,775 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:43,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:43,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:43,775 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:43,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:43,776 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 21:12:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:43,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,779 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:43,779 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:43,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,781 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,781 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,782 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,782 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 21:12:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 21:12:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,782 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:43,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,788 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:43,793 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:43,793 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:43,793 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:43,793 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:43,795 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:43,796 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:43,796 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:43,802 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,802 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:43,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:43,807 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,807 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,807 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:43,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:43,807 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,807 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,808 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:43,809 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,809 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:43,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f72c050[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:43,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:43,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f72c050[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:43,813 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 21:12:43,813 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:43,822 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,822 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:43,824 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:43,824 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:43,824 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:43,825 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. started... 2023-07-17 21:12:43,825 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:43,825 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:43,825 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:43,826 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:43,828 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:43,828 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f59b71d457583210793ad5a2c3fefac0: 2023-07-17 21:12:43,828 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:43,828 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. started... 2023-07-17 21:12:43,828 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,828 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:43,828 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:43,830 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cbf2d6524cc0445935f42b9459fb3ce2: 2023-07-17 21:12:43,830 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,830 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:43,830 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 21:12:43,847 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:43,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:43,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:43,848 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:43,859 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. completed. 2023-07-17 21:12:43,859 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:43,859 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:43,859 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:43,859 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,859 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:43,859 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:43,860 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:43,860 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,860 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:43,861 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:43,867 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. completed. 2023-07-17 21:12:43,867 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:43,867 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:43,867 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:43,867 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,867 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:43,867 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:43,869 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:43,869 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:43,869 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:43,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,870 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:43,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:12:43,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 21:12:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:43,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:43,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:43,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:43,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 21:12:43,887 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 21:12:43,887 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:43,887 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:43,887 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,887 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:43,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,889 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:43,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:43,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:43,890 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,891 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,892 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:43,896 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,897 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,897 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:43,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:43,903 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:43,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,902 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,903 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:43,905 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:43,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:43,905 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:43,905 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:43,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:43,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,905 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:43,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:43,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:43,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,906 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:43,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:43,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 21:12:43,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,938 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:43,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689628363745Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628363903 (+158 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628363903Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628363909 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689628363916 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689628363938 (+22 ms) 2023-07-17 21:12:43,941 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:43,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 195 msec 2023-07-17 21:12:44,048 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:44,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:44,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:44,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42831] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:44,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34535] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 21:12:44,076 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,077 DEBUG [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:44,077 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 21:12:44,088 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:44,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689628364088 (current time:1689628364088). 2023-07-17 21:12:44,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 21:12:44,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x3397c729 to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:44,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d0ed7d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:44,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:44,106 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:44,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3397c729 to 127.0.0.1:53065 2023-07-17 21:12:44,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:44,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(139): Connect 0x5a12afea to 127.0.0.1:53065 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 21:12:44,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57b1850e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 21:12:44,127 DEBUG [hconnection-0x6cba4052-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:44,132 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 21:12:44,138 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 21:12:44,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a12afea to 127.0.0.1:53065 2023-07-17 21:12:44,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:12:44,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 21:12:44,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 21:12:44,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:44,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:44,146 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:44,147 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689628964147 2023-07-17 21:12:44,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 21:12:44,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,149 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 21:12:44,149 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 21:12:44,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:44,151 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 21:12:44,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-17 21:12:44,153 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:44,154 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689628964154 2023-07-17 21:12:44,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,168 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 21:12:44,168 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:44,170 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 21:12:44,170 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 21:12:44,170 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,170 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,171 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:44,171 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:44,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:44,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:44,172 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:44,172 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:44,172 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,172 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,173 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,174 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:44,174 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 21:12:44,174 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,176 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:44,176 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:44,176 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:44,177 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:44,177 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:44,176 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 21:12:44,177 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 21:12:44,177 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:44,177 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 21:12:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 21:12:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36811,1689628244152' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 21:12:44,180 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,180 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:44,181 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,181 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,183 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 21:12:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:44,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42831,1689628244018' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:44,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f4af2f3[Count = 1] remaining members to acquire global barrier 2023-07-17 21:12:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:44,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34535,1689628244104' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 21:12:44,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f4af2f3[Count = 0] remaining members to acquire global barrier 2023-07-17 21:12:44,188 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 21:12:44,188 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,195 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:44,195 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:44,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:44,196 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:44,196 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36811,1689628244152' in zk 2023-07-17 21:12:44,196 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:44,196 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. started... 2023-07-17 21:12:44,196 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. started... 2023-07-17 21:12:44,197 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f59b71d457583210793ad5a2c3fefac0 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-17 21:12:44,197 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cbf2d6524cc0445935f42b9459fb3ce2 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-17 21:12:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:44,198 DEBUG [member: 'jenkins-hbase4.apache.org,36811,1689628244152' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:44,200 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,201 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,201 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 21:12:44,227 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/.tmp/cf/62d17db76b844e69913cd47835a6f926 2023-07-17 21:12:44,230 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/.tmp/cf/723cb3d75bf04b9083a16e19be9dfac7 2023-07-17 21:12:44,233 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/.tmp/cf/62d17db76b844e69913cd47835a6f926 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf/62d17db76b844e69913cd47835a6f926 2023-07-17 21:12:44,237 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/.tmp/cf/723cb3d75bf04b9083a16e19be9dfac7 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf/723cb3d75bf04b9083a16e19be9dfac7 2023-07-17 21:12:44,239 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf/62d17db76b844e69913cd47835a6f926, entries=7, sequenceid=6, filesize=5.3 K 2023-07-17 21:12:44,241 INFO [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for f59b71d457583210793ad5a2c3fefac0 in 44ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:44,241 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 21:12:44,241 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f59b71d457583210793ad5a2c3fefac0: 2023-07-17 21:12:44,241 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,241 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:44,241 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf/62d17db76b844e69913cd47835a6f926] hfiles 2023-07-17 21:12:44,241 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf/62d17db76b844e69913cd47835a6f926 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,245 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf/723cb3d75bf04b9083a16e19be9dfac7, entries=43, sequenceid=6, filesize=7.7 K 2023-07-17 21:12:44,246 INFO [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for cbf2d6524cc0445935f42b9459fb3ce2 in 50ms, sequenceid=6, compaction requested=false 2023-07-17 21:12:44,248 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cbf2d6524cc0445935f42b9459fb3ce2: 2023-07-17 21:12:44,248 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,248 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 21:12:44,248 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf/723cb3d75bf04b9083a16e19be9dfac7] hfiles 2023-07-17 21:12:44,248 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf/723cb3d75bf04b9083a16e19be9dfac7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,249 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:44,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:44,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 21:12:44,251 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 21:12:44,257 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. completed. 2023-07-17 21:12:44,257 DEBUG [rs(jenkins-hbase4.apache.org,42831,1689628244018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:12:44,258 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:44,258 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:44,258 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,258 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:44,258 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42831,1689628244018' in zk 2023-07-17 21:12:44,260 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,42831,1689628244018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42831,1689628244018': 2023-07-17 21:12:44,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42831,1689628244018' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 21:12:44,267 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. completed. 2023-07-17 21:12:44,267 DEBUG [rs(jenkins-hbase4.apache.org,34535,1689628244104)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:12:44,267 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 21:12:44,267 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 21:12:44,267 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,268 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 21:12:44,268 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34535,1689628244104' in zk 2023-07-17 21:12:44,270 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,270 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 21:12:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:44,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:44,270 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:44,270 DEBUG [member: 'jenkins-hbase4.apache.org,34535,1689628244104' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 21:12:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:44,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34535,1689628244104': 2023-07-17 21:12:44,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34535,1689628244104' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 21:12:44,277 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 21:12:44,277 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 21:12:44,277 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 21:12:44,277 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,277 INFO [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 21:12:44,279 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:44,279 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:44,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,280 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,279 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:44,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 21:12:44,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:44,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 21:12:44,281 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,282 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 21:12:44,282 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,284 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,284 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,284 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:44,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:44,288 DEBUG [(jenkins-hbase4.apache.org,38665,1689628242426)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:44,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 21:12:44,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:44,288 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 21:12:44,292 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,292 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:12:44,292 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,293 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:12:44,293 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:12:44,293 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,293 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 21:12:44,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:44,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 21:12:44,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:44,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:44,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:44,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:44,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 21:12:44,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 21:12:44,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-17 21:12:44,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,363 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 21:12:44,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,364 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689628364147Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689628364293 (+146 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689628364293Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689628364298 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689628364324 (+26 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689628364363 (+39 ms) 2023-07-17 21:12:44,368 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 21:12:44,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 219 msec 2023-07-17 21:12:44,451 DEBUG [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 21:12:44,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 21:12:44,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 21:12:44,452 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452 2023-07-17 21:12:44,453 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38145, tgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452, rawTgtDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452, srcFsUri=hdfs://localhost:38145, srcDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:12:44,481 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39 2023-07-17 21:12:44,481 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-776100949_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,481 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38145, inputRoot=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39, snapshotDir=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 21:12:44,490 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:12:44,522 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:44,523 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:44,523 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:44,524 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,552 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-5708314695218521416.jar 2023-07-17 21:12:45,553 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,553 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/hadoop-4237289458945832575.jar 2023-07-17 21:12:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,623 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,623 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,623 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,624 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,624 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 21:12:45,624 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 21:12:45,625 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 21:12:45,625 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 21:12:45,625 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 21:12:45,626 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 21:12:45,626 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 21:12:45,627 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 21:12:45,627 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 21:12:45,627 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 21:12:45,628 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 21:12:45,628 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:45,629 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:45,629 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:45,629 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:45,630 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 21:12:45,630 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:45,631 DEBUG [Listener at jenkins-hbase4.apache.org/41521] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 21:12:46,142 WARN [Listener at jenkins-hbase4.apache.org/41521] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 21:12:46,145 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 21:12:46,147 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 21:12:46,251 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:46,251 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 21:12:46,254 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0006_000001 (auth:SIMPLE) 2023-07-17 21:12:46,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0007_000001 (auth:SIMPLE) 2023-07-17 21:12:47,596 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:12:51,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0007_000001 (auth:SIMPLE) 2023-07-17 21:12:54,159 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0007_000001 (auth:SIMPLE) 2023-07-17 21:12:59,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0007_000001 (auth:SIMPLE) 2023-07-17 21:13:00,385 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 21:13:00,385 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 21:13:00,395 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,395 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 21:13:00,396 INFO [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 21:13:00,396 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,397 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 21:13:00,398 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 21:13:00,398 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191065308_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,398 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 21:13:00,398 DEBUG [Listener at jenkins-hbase4.apache.org/41521] snapshot.TestExportSnapshot(367): hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/export-test/export-1689628364452/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 21:13:00,413 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 21:13:00,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628380418"}]},"ts":"1689628380418"} 2023-07-17 21:13:00,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 21:13:00,421 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 21:13:00,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, UNASSIGN}] 2023-07-17 21:13:00,424 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, UNASSIGN 2023-07-17 21:13:00,425 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, UNASSIGN 2023-07-17 21:13:00,425 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f59b71d457583210793ad5a2c3fefac0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:13:00,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=cbf2d6524cc0445935f42b9459fb3ce2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:13:00,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628380425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628380425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628380425"}]},"ts":"1689628380425"} 2023-07-17 21:13:00,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628380425"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689628380425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689628380425"}]},"ts":"1689628380425"} 2023-07-17 21:13:00,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure f59b71d457583210793ad5a2c3fefac0, server=jenkins-hbase4.apache.org,42831,1689628244018}] 2023-07-17 21:13:00,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure cbf2d6524cc0445935f42b9459fb3ce2, server=jenkins-hbase4.apache.org,34535,1689628244104}] 2023-07-17 21:13:00,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 21:13:00,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:13:00,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f59b71d457583210793ad5a2c3fefac0, disabling compactions & flushes 2023-07-17 21:13:00,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:13:00,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:13:00,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. after waiting 0 ms 2023-07-17 21:13:00,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:13:00,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:13:00,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cbf2d6524cc0445935f42b9459fb3ce2, disabling compactions & flushes 2023-07-17 21:13:00,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:13:00,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:13:00,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. after waiting 0 ms 2023-07-17 21:13:00,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:13:00,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:13:00,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:13:00,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:00,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0. 2023-07-17 21:13:00,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f59b71d457583210793ad5a2c3fefac0: 2023-07-17 21:13:00,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:00,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2. 2023-07-17 21:13:00,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cbf2d6524cc0445935f42b9459fb3ce2: 2023-07-17 21:13:00,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:13:00,606 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f59b71d457583210793ad5a2c3fefac0, regionState=CLOSED 2023-07-17 21:13:00,607 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628380606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628380606"}]},"ts":"1689628380606"} 2023-07-17 21:13:00,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:13:00,609 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=cbf2d6524cc0445935f42b9459fb3ce2, regionState=CLOSED 2023-07-17 21:13:00,609 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689628380609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689628380609"}]},"ts":"1689628380609"} 2023-07-17 21:13:00,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-17 21:13:00,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure f59b71d457583210793ad5a2c3fefac0, server=jenkins-hbase4.apache.org,42831,1689628244018 in 183 msec 2023-07-17 21:13:00,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-17 21:13:00,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f59b71d457583210793ad5a2c3fefac0, UNASSIGN in 192 msec 2023-07-17 21:13:00,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure cbf2d6524cc0445935f42b9459fb3ce2, server=jenkins-hbase4.apache.org,34535,1689628244104 in 183 msec 2023-07-17 21:13:00,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-17 21:13:00,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cbf2d6524cc0445935f42b9459fb3ce2, UNASSIGN in 194 msec 2023-07-17 21:13:00,618 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689628380618"}]},"ts":"1689628380618"} 2023-07-17 21:13:00,620 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 21:13:00,622 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 21:13:00,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 208 msec 2023-07-17 21:13:00,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 21:13:00,720 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 21:13:00,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,725 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,727 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,727 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,730 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,730 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,730 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,730 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,730 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 21:13:00,730 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 21:13:00,731 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 21:13:00,731 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:00,733 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 21:13:00,734 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:13:00,734 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:13:00,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 21:13:00,736 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/recovered.edits] 2023-07-17 21:13:00,737 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf, FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/recovered.edits] 2023-07-17 21:13:00,742 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf/62d17db76b844e69913cd47835a6f926 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/cf/62d17db76b844e69913cd47835a6f926 2023-07-17 21:13:00,743 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf/723cb3d75bf04b9083a16e19be9dfac7 to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/cf/723cb3d75bf04b9083a16e19be9dfac7 2023-07-17 21:13:00,747 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0/recovered.edits/9.seqid 2023-07-17 21:13:00,748 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f59b71d457583210793ad5a2c3fefac0 2023-07-17 21:13:00,748 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/recovered.edits/9.seqid to hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2/recovered.edits/9.seqid 2023-07-17 21:13:00,748 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cbf2d6524cc0445935f42b9459fb3ce2 2023-07-17 21:13:00,748 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 21:13:00,751 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,753 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 21:13:00,756 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 21:13:00,757 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,758 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 21:13:00,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628380758"}]},"ts":"9223372036854775807"} 2023-07-17 21:13:00,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689628380758"}]},"ts":"9223372036854775807"} 2023-07-17 21:13:00,762 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 21:13:00,762 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f59b71d457583210793ad5a2c3fefac0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689628362464.f59b71d457583210793ad5a2c3fefac0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cbf2d6524cc0445935f42b9459fb3ce2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689628362464.cbf2d6524cc0445935f42b9459fb3ce2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 21:13:00,762 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 21:13:00,762 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689628380762"}]},"ts":"9223372036854775807"} 2023-07-17 21:13:00,772 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 21:13:00,774 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 53 msec 2023-07-17 21:13:00,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 21:13:00,836 INFO [Listener at jenkins-hbase4.apache.org/41521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 21:13:00,856 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 21:13:00,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 21:13:00,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38665] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 21:13:00,895 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=769 (was 765) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:44532 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5208 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:46884 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191065308_17 at /127.0.0.1:55104 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-738498191_1 at /127.0.0.1:45518 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase4.apache.org/172.31.14.131:44205 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-738498191_1 at /127.0.0.1:34946 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16ba867e-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=753 (was 695) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1587 (was 1908) 2023-07-17 21:13:00,896 WARN [Listener at jenkins-hbase4.apache.org/41521] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-17 21:13:00,896 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 21:13:00,914 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:05,317 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689628253208_0007_000001 (auth:SIMPLE) 2023-07-17 21:13:06,181 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 21:13:15,041 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:29,160 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 21:13:29,161 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:29,271 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 21:13:29,279 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 21:13:29,281 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 21:13:29,295 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 21:13:29,399 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 21:13:29,399 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 21:13:29,399 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 21:13:29,399 INFO [Listener at jenkins-hbase4.apache.org/41521] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 21:13:29,399 DEBUG [Listener at jenkins-hbase4.apache.org/41521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a81cdeb to 127.0.0.1:53065 2023-07-17 21:13:29,399 DEBUG [Listener at jenkins-hbase4.apache.org/41521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,400 DEBUG [Listener at jenkins-hbase4.apache.org/41521] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 21:13:29,400 DEBUG [Listener at jenkins-hbase4.apache.org/41521] util.JVMClusterUtil(257): Found active master hash=549704716, stopped=false 2023-07-17 21:13:29,400 DEBUG [Listener at jenkins-hbase4.apache.org/41521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,400 DEBUG [Listener at jenkins-hbase4.apache.org/41521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 21:13:29,400 INFO [Listener at jenkins-hbase4.apache.org/41521] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:13:29,453 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:29,453 INFO [Listener at jenkins-hbase4.apache.org/41521] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 21:13:29,453 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:29,453 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:29,454 DEBUG [Listener at jenkins-hbase4.apache.org/41521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f0afdd0 to 127.0.0.1:53065 2023-07-17 21:13:29,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:29,453 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 21:13:29,454 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:13:29,454 DEBUG [Listener at jenkins-hbase4.apache.org/41521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:29,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:29,454 INFO [Listener at jenkins-hbase4.apache.org/41521] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42831,1689628244018' ***** 2023-07-17 21:13:29,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 21:13:29,454 DEBUG [Listener at jenkins-hbase4.apache.org/41521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,454 INFO [Listener at jenkins-hbase4.apache.org/41521] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 21:13:29,455 INFO [Listener at jenkins-hbase4.apache.org/41521] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34535,1689628244104' ***** 2023-07-17 21:13:29,455 DEBUG [Listener at jenkins-hbase4.apache.org/41521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,455 INFO [Listener at jenkins-hbase4.apache.org/41521] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 21:13:29,455 INFO [Listener at jenkins-hbase4.apache.org/41521] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36811,1689628244152' ***** 2023-07-17 21:13:29,455 INFO [RS:0;jenkins-hbase4:42831] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 21:13:29,455 DEBUG [Listener at jenkins-hbase4.apache.org/41521] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,455 INFO [Listener at jenkins-hbase4.apache.org/41521] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 21:13:29,455 INFO [RS:0;jenkins-hbase4:42831] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 21:13:29,455 INFO [RS:1;jenkins-hbase4:34535] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 21:13:29,455 INFO [RS:0;jenkins-hbase4:42831] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 21:13:29,455 INFO [RS:1;jenkins-hbase4:34535] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 21:13:29,455 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 21:13:29,455 INFO [RS:1;jenkins-hbase4:34535] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 21:13:29,455 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:13:29,455 DEBUG [RS:0;jenkins-hbase4:42831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53233c4f to 127.0.0.1:53065 2023-07-17 21:13:29,455 INFO [RS:2;jenkins-hbase4:36811] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 21:13:29,455 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 21:13:29,456 INFO [RS:2;jenkins-hbase4:36811] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 21:13:29,456 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 21:13:29,456 DEBUG [RS:0;jenkins-hbase4:42831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,455 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(3305): Received CLOSE for 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:13:29,456 INFO [RS:2;jenkins-hbase4:36811] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 21:13:29,458 INFO [RS:0;jenkins-hbase4:42831] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 21:13:29,458 INFO [RS:0;jenkins-hbase4:42831] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 21:13:29,458 INFO [RS:0;jenkins-hbase4:42831] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 21:13:29,458 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(3305): Received CLOSE for bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:13:29,458 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 21:13:29,459 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:13:29,459 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:13:29,459 DEBUG [RS:1;jenkins-hbase4:34535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddad224 to 127.0.0.1:53065 2023-07-17 21:13:29,459 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x747d6ee4 to 127.0.0.1:53065 2023-07-17 21:13:29,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19f3a62f59b7bf7beaaa1895627e9d70, disabling compactions & flushes 2023-07-17 21:13:29,459 DEBUG [RS:1;jenkins-hbase4:34535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 21:13:29,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:13:29,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bd817a1886d2af92cae5328f2e77495c, disabling compactions & flushes 2023-07-17 21:13:29,459 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 21:13:29,459 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,461 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-17 21:13:29,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:13:29,461 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 21:13:29,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:13:29,461 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1478): Online Regions={bd817a1886d2af92cae5328f2e77495c=hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c.} 2023-07-17 21:13:29,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. after waiting 0 ms 2023-07-17 21:13:29,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:13:29,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 21:13:29,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 19f3a62f59b7bf7beaaa1895627e9d70 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 21:13:29,461 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 21:13:29,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 21:13:29,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:13:29,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 21:13:29,462 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1478): Online Regions={19f3a62f59b7bf7beaaa1895627e9d70=hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70.} 2023-07-17 21:13:29,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 21:13:29,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. after waiting 0 ms 2023-07-17 21:13:29,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:13:29,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 21:13:29,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bd817a1886d2af92cae5328f2e77495c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 21:13:29,462 DEBUG [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-17 21:13:29,462 DEBUG [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1504): Waiting on 19f3a62f59b7bf7beaaa1895627e9d70 2023-07-17 21:13:29,462 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1504): Waiting on bd817a1886d2af92cae5328f2e77495c 2023-07-17 21:13:29,479 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:29,480 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:29,485 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:29,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/.tmp/info/cab5f3cc430e42b0b8a91ad8f74f7534 2023-07-17 21:13:29,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/.tmp/info/64350d57ab994fd59b7b1fdcf0679201 2023-07-17 21:13:29,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/.tmp/l/a33e11a745374ada91cab143b1e9f22c 2023-07-17 21:13:29,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/.tmp/info/cab5f3cc430e42b0b8a91ad8f74f7534 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/info/cab5f3cc430e42b0b8a91ad8f74f7534 2023-07-17 21:13:29,519 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64350d57ab994fd59b7b1fdcf0679201 2023-07-17 21:13:29,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/info/cab5f3cc430e42b0b8a91ad8f74f7534, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 21:13:29,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a33e11a745374ada91cab143b1e9f22c 2023-07-17 21:13:29,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 19f3a62f59b7bf7beaaa1895627e9d70 in 70ms, sequenceid=6, compaction requested=false 2023-07-17 21:13:29,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/.tmp/l/a33e11a745374ada91cab143b1e9f22c as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/l/a33e11a745374ada91cab143b1e9f22c 2023-07-17 21:13:29,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a33e11a745374ada91cab143b1e9f22c 2023-07-17 21:13:29,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/l/a33e11a745374ada91cab143b1e9f22c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 21:13:29,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for bd817a1886d2af92cae5328f2e77495c in 77ms, sequenceid=18, compaction requested=false 2023-07-17 21:13:29,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/namespace/19f3a62f59b7bf7beaaa1895627e9d70/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 21:13:29,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:13:29,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19f3a62f59b7bf7beaaa1895627e9d70: 2023-07-17 21:13:29,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689628246915.19f3a62f59b7bf7beaaa1895627e9d70. 2023-07-17 21:13:29,556 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/.tmp/rep_barrier/d777ac4b6ac047e084b108856bcb5925 2023-07-17 21:13:29,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/acl/bd817a1886d2af92cae5328f2e77495c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 21:13:29,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:13:29,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bd817a1886d2af92cae5328f2e77495c: 2023-07-17 21:13:29,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689628247788.bd817a1886d2af92cae5328f2e77495c. 2023-07-17 21:13:29,560 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d777ac4b6ac047e084b108856bcb5925 2023-07-17 21:13:29,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/.tmp/table/896c6ed0f16140b0a4c12311d73a2181 2023-07-17 21:13:29,578 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 896c6ed0f16140b0a4c12311d73a2181 2023-07-17 21:13:29,578 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/.tmp/info/64350d57ab994fd59b7b1fdcf0679201 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/info/64350d57ab994fd59b7b1fdcf0679201 2023-07-17 21:13:29,582 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64350d57ab994fd59b7b1fdcf0679201 2023-07-17 21:13:29,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/info/64350d57ab994fd59b7b1fdcf0679201, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 21:13:29,583 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/.tmp/rep_barrier/d777ac4b6ac047e084b108856bcb5925 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/rep_barrier/d777ac4b6ac047e084b108856bcb5925 2023-07-17 21:13:29,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d777ac4b6ac047e084b108856bcb5925 2023-07-17 21:13:29,587 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/rep_barrier/d777ac4b6ac047e084b108856bcb5925, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 21:13:29,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/.tmp/table/896c6ed0f16140b0a4c12311d73a2181 as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/table/896c6ed0f16140b0a4c12311d73a2181 2023-07-17 21:13:29,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 896c6ed0f16140b0a4c12311d73a2181 2023-07-17 21:13:29,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/table/896c6ed0f16140b0a4c12311d73a2181, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 21:13:29,594 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 132ms, sequenceid=131, compaction requested=false 2023-07-17 21:13:29,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 21:13:29,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 21:13:29,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 21:13:29,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 21:13:29,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 21:13:29,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 21:13:29,662 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42831,1689628244018; all regions closed. 2023-07-17 21:13:29,662 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34535,1689628244104; all regions closed. 2023-07-17 21:13:29,662 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36811,1689628244152; all regions closed. 2023-07-17 21:13:29,675 DEBUG [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs 2023-07-17 21:13:29,675 DEBUG [RS:1;jenkins-hbase4:34535] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs 2023-07-17 21:13:29,676 INFO [RS:1;jenkins-hbase4:34535] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34535%2C1689628244104:(num 1689628246355) 2023-07-17 21:13:29,676 INFO [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42831%2C1689628244018.meta:.meta(num 1689628246536) 2023-07-17 21:13:29,676 DEBUG [RS:1;jenkins-hbase4:34535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,676 DEBUG [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs 2023-07-17 21:13:29,676 INFO [RS:1;jenkins-hbase4:34535] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:29,676 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36811%2C1689628244152:(num 1689628246368) 2023-07-17 21:13:29,676 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,676 INFO [RS:2;jenkins-hbase4:36811] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:29,677 INFO [RS:1;jenkins-hbase4:34535] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 21:13:29,677 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 21:13:29,678 INFO [RS:1;jenkins-hbase4:34535] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 21:13:29,678 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:29,678 INFO [RS:1;jenkins-hbase4:34535] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 21:13:29,678 INFO [RS:1;jenkins-hbase4:34535] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 21:13:29,678 INFO [RS:2;jenkins-hbase4:36811] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 21:13:29,678 INFO [RS:2;jenkins-hbase4:36811] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 21:13:29,678 INFO [RS:2;jenkins-hbase4:36811] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 21:13:29,678 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:29,681 INFO [RS:2;jenkins-hbase4:36811] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36811 2023-07-17 21:13:29,680 INFO [RS:1;jenkins-hbase4:34535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34535 2023-07-17 21:13:29,687 DEBUG [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/oldWALs 2023-07-17 21:13:29,687 INFO [RS:0;jenkins-hbase4:42831] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42831%2C1689628244018:(num 1689628246363) 2023-07-17 21:13:29,687 DEBUG [RS:0;jenkins-hbase4:42831] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,687 INFO [RS:0;jenkins-hbase4:42831] regionserver.LeaseManager(133): Closed leases 2023-07-17 21:13:29,688 INFO [RS:0;jenkins-hbase4:42831] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 21:13:29,688 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:29,689 INFO [RS:0;jenkins-hbase4:42831] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42831 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34535,1689628244104 2023-07-17 21:13:29,691 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 21:13:29,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:13:29,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:13:29,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:13:29,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:13:29,692 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42831,1689628244018] 2023-07-17 21:13:29,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42831,1689628244018 2023-07-17 21:13:29,692 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36811,1689628244152 2023-07-17 21:13:29,694 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42831,1689628244018; numProcessing=1 2023-07-17 21:13:29,698 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42831,1689628244018 already deleted, retry=false 2023-07-17 21:13:29,698 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42831,1689628244018 expired; onlineServers=2 2023-07-17 21:13:29,698 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36811,1689628244152] 2023-07-17 21:13:29,698 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36811,1689628244152; numProcessing=2 2023-07-17 21:13:29,797 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:29,797 INFO [RS:1;jenkins-hbase4:34535] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34535,1689628244104; zookeeper connection closed. 2023-07-17 21:13:29,797 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:34535-0x101751f711f0002, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:29,797 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45dc0d5b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45dc0d5b 2023-07-17 21:13:29,798 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:29,798 INFO [RS:0;jenkins-hbase4:42831] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42831,1689628244018; zookeeper connection closed. 2023-07-17 21:13:29,798 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:42831-0x101751f711f0001, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:29,798 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4649bd67] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4649bd67 2023-07-17 21:13:29,800 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36811,1689628244152 already deleted, retry=false 2023-07-17 21:13:29,800 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36811,1689628244152 expired; onlineServers=1 2023-07-17 21:13:29,800 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34535,1689628244104] 2023-07-17 21:13:29,800 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34535,1689628244104; numProcessing=3 2023-07-17 21:13:29,898 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:29,898 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36811,1689628244152; zookeeper connection closed. 2023-07-17 21:13:29,898 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x101751f711f0003, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:29,898 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@261c3502] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@261c3502 2023-07-17 21:13:29,899 INFO [Listener at jenkins-hbase4.apache.org/41521] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 21:13:29,899 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34535,1689628244104 already deleted, retry=false 2023-07-17 21:13:29,899 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34535,1689628244104 expired; onlineServers=0 2023-07-17 21:13:29,899 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38665,1689628242426' ***** 2023-07-17 21:13:29,899 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 21:13:29,899 DEBUG [M:0;jenkins-hbase4:38665] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61fede37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 21:13:29,900 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38665,1689628242426 2023-07-17 21:13:29,900 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38665,1689628242426; all regions closed. 2023-07-17 21:13:29,900 DEBUG [M:0;jenkins-hbase4:38665] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 21:13:29,900 DEBUG [M:0;jenkins-hbase4:38665] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 21:13:29,900 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 21:13:29,900 DEBUG [M:0;jenkins-hbase4:38665] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 21:13:29,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689628245859] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689628245859,5,FailOnTimeoutGroup] 2023-07-17 21:13:29,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689628245858] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689628245858,5,FailOnTimeoutGroup] 2023-07-17 21:13:29,900 INFO [M:0;jenkins-hbase4:38665] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 21:13:29,900 INFO [M:0;jenkins-hbase4:38665] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 21:13:29,900 INFO [M:0;jenkins-hbase4:38665] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 21:13:29,900 DEBUG [M:0;jenkins-hbase4:38665] master.HMaster(1512): Stopping service threads 2023-07-17 21:13:29,900 INFO [M:0;jenkins-hbase4:38665] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 21:13:29,901 ERROR [M:0;jenkins-hbase4:38665] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 21:13:29,901 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-17 21:13:29,901 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 21:13:29,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 21:13:29,902 INFO [M:0;jenkins-hbase4:38665] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 21:13:29,902 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 21:13:29,902 DEBUG [M:0;jenkins-hbase4:38665] zookeeper.ZKUtil(398): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 21:13:29,902 WARN [M:0;jenkins-hbase4:38665] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 21:13:29,902 INFO [M:0;jenkins-hbase4:38665] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 21:13:29,902 INFO [M:0;jenkins-hbase4:38665] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 21:13:29,903 DEBUG [M:0;jenkins-hbase4:38665] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 21:13:29,903 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:29,903 DEBUG [M:0;jenkins-hbase4:38665] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:29,903 DEBUG [M:0;jenkins-hbase4:38665] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 21:13:29,903 DEBUG [M:0;jenkins-hbase4:38665] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:29,903 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.42 KB heapSize=449.70 KB 2023-07-17 21:13:29,917 INFO [M:0;jenkins-hbase4:38665] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.42 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/053144c82c424c99ac013ae7a674ad3e 2023-07-17 21:13:29,921 INFO [M:0;jenkins-hbase4:38665] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 053144c82c424c99ac013ae7a674ad3e 2023-07-17 21:13:29,922 DEBUG [M:0;jenkins-hbase4:38665] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/053144c82c424c99ac013ae7a674ad3e as hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/053144c82c424c99ac013ae7a674ad3e 2023-07-17 21:13:29,925 INFO [M:0;jenkins-hbase4:38665] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 053144c82c424c99ac013ae7a674ad3e 2023-07-17 21:13:29,926 INFO [M:0;jenkins-hbase4:38665] regionserver.HStore(1080): Added hdfs://localhost:38145/user/jenkins/test-data/5cbf2ff6-246a-0031-8d51-4e364d5b9a39/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/053144c82c424c99ac013ae7a674ad3e, entries=119, sequenceid=899, filesize=28.4 K 2023-07-17 21:13:29,926 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegion(2948): Finished flush of dataSize ~373.42 KB/382382, heapSize ~449.69 KB/460480, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-07-17 21:13:29,928 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 21:13:29,928 DEBUG [M:0;jenkins-hbase4:38665] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 21:13:29,931 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 21:13:29,931 INFO [M:0;jenkins-hbase4:38665] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 21:13:29,932 INFO [M:0;jenkins-hbase4:38665] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38665 2023-07-17 21:13:29,933 DEBUG [M:0;jenkins-hbase4:38665] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38665,1689628242426 already deleted, retry=false 2023-07-17 21:13:30,036 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:30,036 INFO [M:0;jenkins-hbase4:38665] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38665,1689628242426; zookeeper connection closed. 2023-07-17 21:13:30,036 DEBUG [Listener at localhost/38753-EventThread] zookeeper.ZKWatcher(600): master:38665-0x101751f711f0000, quorum=127.0.0.1:53065, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 21:13:30,037 WARN [Listener at jenkins-hbase4.apache.org/41521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 21:13:30,041 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:30,146 WARN [BP-1106659820-172.31.14.131-1689628237932 heartbeating to localhost/127.0.0.1:38145] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 21:13:30,146 WARN [BP-1106659820-172.31.14.131-1689628237932 heartbeating to localhost/127.0.0.1:38145] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1106659820-172.31.14.131-1689628237932 (Datanode Uuid 9e7eb5e6-b60b-4ac9-9386-eb6b5b23980d) service to localhost/127.0.0.1:38145 2023-07-17 21:13:30,148 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data5/current/BP-1106659820-172.31.14.131-1689628237932] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:30,148 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data6/current/BP-1106659820-172.31.14.131-1689628237932] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:30,149 WARN [Listener at jenkins-hbase4.apache.org/41521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 21:13:30,153 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:30,256 WARN [BP-1106659820-172.31.14.131-1689628237932 heartbeating to localhost/127.0.0.1:38145] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 21:13:30,256 WARN [BP-1106659820-172.31.14.131-1689628237932 heartbeating to localhost/127.0.0.1:38145] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1106659820-172.31.14.131-1689628237932 (Datanode Uuid 328abeb5-08dd-46f9-8bf9-d61e15113814) service to localhost/127.0.0.1:38145 2023-07-17 21:13:30,258 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data3/current/BP-1106659820-172.31.14.131-1689628237932] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:30,258 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data4/current/BP-1106659820-172.31.14.131-1689628237932] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:30,260 WARN [Listener at jenkins-hbase4.apache.org/41521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 21:13:30,262 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:30,366 WARN [BP-1106659820-172.31.14.131-1689628237932 heartbeating to localhost/127.0.0.1:38145] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 21:13:30,367 WARN [BP-1106659820-172.31.14.131-1689628237932 heartbeating to localhost/127.0.0.1:38145] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1106659820-172.31.14.131-1689628237932 (Datanode Uuid 5545e066-12da-49d5-8ca3-5b06c2e55309) service to localhost/127.0.0.1:38145 2023-07-17 21:13:30,367 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data1/current/BP-1106659820-172.31.14.131-1689628237932] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:30,368 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d7af82b8-6696-a789-1f56-27d1654884b1/cluster_65a8e2db-9ef5-6aec-e2db-d1ed93aae31e/dfs/data/data2/current/BP-1106659820-172.31.14.131-1689628237932] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 21:13:30,390 INFO [Listener at jenkins-hbase4.apache.org/41521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 21:13:30,515 INFO [Listener at jenkins-hbase4.apache.org/41521] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 21:13:30,613 INFO [Listener at jenkins-hbase4.apache.org/41521] hbase.HBaseTestingUtility(1293): Minicluster is down